Wed May 2 04:15:45 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000002.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1031588 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 04:15:52,075 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 04:15:52,080 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 04:15:52,081 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 04:15:52,082 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 04:15:52,082 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 04:15:53,220 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 04:15:53,220 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 04:15:53,220 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 04:15:53,220 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:15:53,223 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 04:15:53,224 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 04:15:53,224 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 04:15:53,224 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:15:53,224 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 04:15:53,224 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 04:15:53,224 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 04:15:53,224 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:15:53,224 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 04:15:53,225 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 04:15:53,225 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 04:15:53,225 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 04:15:53,225 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 04:15:53,225 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 04:15:53,225 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 04:15:53,226 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 04:15:53,226 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 04:15:53,226 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 04:15:53,226 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:15:53,226 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 04:15:53,227 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 04:15:53,227 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 04:15:53,227 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 04:15:53,227 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020415 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 04:15:53,227 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 04:15:53,227 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 04:15:53,228 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 04:15:53,228 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log 2018-05-02 04:15:53,228 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 04:15:53,228 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 04:15:53,228 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 04:15:53,228 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 04:15:53,229 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=409596 2018-05-02 04:15:53,229 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:15:53,229 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 04:15:53,229 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 04:15:53,229 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 04:15:53,229 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 04:15:53,229 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:15:53,229 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 04:15:53,230 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 04:15:53,249 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:15:53,250 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020415 2018-05-02 04:15:53,256 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 04:15:53,256 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 04:15:53,256 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:15:53,256 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 04:15:53,256 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 04:15:53,256 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 04:15:53,256 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 04:15:53,256 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 04:15:53,257 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 04:15:53,263 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 04:15:53,269 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020415, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 04:15:55,690 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 04:15:55,828 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:15:57,016 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:15:57,028 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:15:57,713 INFO [main] timeline.HadoopTimelineMetricsSink: No suitable collector found. 2018-05-02 04:15:57,749 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:15:58,493 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:15:58,493 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:15:58,632 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 04:16:00,114 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 server-side Connection retries=105 2018-05-02 04:16:00,244 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:16:00,250 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 04:16:00,250 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 04:16:00,251 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 04:16:00,252 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:16:00,252 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:16:00,969 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 04:16:01,396 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 04:16:01,795 INFO [main] ipc.NettyRpcServer: Bind to /172.27.70.95:16020 2018-05-02 04:16:02,124 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 04:16:02,133 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=819.20 MB, blockSize=64 KB 2018-05-02 04:16:02,186 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:16:02,194 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:16:05,125 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:16:05,429 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:16:05,651 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 04:16:05,677 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 04:16:05,677 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:16:05,677 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 04:16:05,677 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 04:16:05,677 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 04:16:05,677 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 04:16:05,681 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:16:05,681 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 04:16:05,681 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 04:16:05,681 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 04:16:05,681 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 04:16:05,681 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=4.15.12-1.el7.elrepo.x86_64 2018-05-02 04:16:05,681 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 04:16:05,682 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 04:16:05,682 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 04:16:05,686 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@ad3324b 2018-05-02 04:16:05,857 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 04:16:05,868 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 04:16:05,881 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:16:05,896 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:16:05,919 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 04:16:05 UTC 2018 2018-05-02 04:16:05,920 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 04:16:05 UTC 2018 2018-05-02 04:16:05,920 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 00:09:53 UTC 2018 2018-05-02 04:16:05,929 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 04:16:05,953 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c001e, negotiated timeout = 90000 2018-05-02 04:16:06,270 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384 2018-05-02 04:16:06,727 INFO [main] util.log: Logging initialized @18354ms 2018-05-02 04:16:06,919 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 04:16:06,939 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 04:16:06,939 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 04:16:06,943 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 04:16:06,943 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 04:16:06,943 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 04:16:07,014 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 04:16:07,017 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 04:16:07,178 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@66273da0{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 04:16:07,179 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@1229a2b7{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 04:16:07,570 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@57272109{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 04:16:07,580 INFO [main] ssl.SslContextFactory: x509=X509@5f69e2b(ctr-e138-1518143905142-279227-01-000002.hwx.site,h=[ctr-e138-1518143905142-279227-01-000002.hwx.site],w=[]) for SslContextFactory@984169e(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 04:16:07,609 INFO [main] server.AbstractConnector: Started ServerConnector@2cc75074{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 04:16:07,609 INFO [main] server.Server: Started @19236ms 2018-05-02 04:17:18,503 INFO [timeline] timeline.HadoopTimelineMetricsSink: No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times. 2018-05-02 04:17:55,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ClusterId : 5e3858a0-79df-4411-900f-33628cd0efb1 2018-05-02 04:17:55,767 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Connect 0x1e03fd3f to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 04:17:55,786 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1e03fd3f] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$47/1463882712@12439754 2018-05-02 04:17:55,788 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1e03fd3f-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:17:55,791 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1e03fd3f-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:17:55,791 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1e03fd3f-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 04:17:55,799 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1e03fd3f-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d939000d, negotiated timeout = 90000 2018-05-02 04:17:56,018 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 04:17:56,018 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 04:17:56,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 04:17:56,098 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 04:17:56,098 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:56,098 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 04:17:56,107 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:56,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 04:17:56,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:56,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 04:17:56,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 04:17:56,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 04:17:56,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:17:56,108 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 04:17:56,504 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 04:17:56,515 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 04:17:56,515 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 04:17:56,522 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 04:17:56,524 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 04:17:56,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 04:17:56,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 04:17:56,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 04:17:56,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 04:17:56,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 04:17:56,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 04:17:56,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 04:17:56,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 04:17:56,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 04:17:56,613 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 04:17:56,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 04:17:56,635 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: init() called 2018-05-02 04:17:56,635 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,635 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 04:17:56,636 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 04:17:56,636 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 04:17:56,637 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 04:17:56,637 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:17:56,637 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 04:17:56,654 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:17:56,654 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 04:17:56,654 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 04:17:56,654 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:17:56,760 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 04:17:56,860 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 04:17:56,861 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 04:17:56,863 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:17:56,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 04:17:56,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 04:17:56,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 04:17:56,878 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 04:17:56,878 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 04:17:56,879 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 04:17:56,879 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 04:17:56,879 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 04:17:56,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 04:17:56,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 04:17:56,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 04:17:56,880 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 04:17:56,881 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 04:17:56,881 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 04:17:56,881 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 04:17:56,881 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 04:17:56,883 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:17:56,883 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,883 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 04:17:56,883 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 04:17:56,886 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 04:17:56,886 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 04:17:56,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:17:56,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:17:56,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 04:17:56,888 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 04:17:56,889 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 04:17:56,889 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 04:17:56,889 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 04:17:56,894 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:17:56,928 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 04:17:56,929 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 04:17:57,357 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:17:58,222 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:17:58,617 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 04:18:04,496 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=2 2018-05-02 04:18:05,285 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:18:05,293 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:18:05,293 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:18:05,302 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 04:18:05,319 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 04:18:05,455 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525234664535 with port=16020, startcode=1525234553384 2018-05-02 04:18:06,756 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 04:18:07,547 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 04:18:07,632 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=778.2 M, Offheap=false 2018-05-02 04:18:07,653 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 04:18:07,658 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 04:18:07,704 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 04:18:07,935 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384 starting 2018-05-02 04:18:07,957 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 04:18:07,970 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 04:18:07,980 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 04:18:08,028 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525234558441] other RSs: [ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525234595085, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525234558441] 2018-05-02 04:18:08,211 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384, RpcServer on ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:16020, sessionid=0x1631f08b26c001e 2018-05-02 04:18:08,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 04:18:08,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 04:18:11,454 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525234553384, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 04:18:12,402 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Slow sync cost: 741 ms, current pipeline: [] 2018-05-02 04:18:12,407 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525234553384.1525234691455 2018-05-02 04:18:33,480 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525234712010.0b19753c89c8b3102c90fe9143d5e4a4. 2018-05-02 04:18:33,859 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 04:18:33,868 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 04:18:33,868 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 04:18:33,868 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 04:18:33,872 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 04:18:33,872 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 04:18:34,095 INFO [StoreOpener-0b19753c89c8b3102c90fe9143d5e4a4-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:18:34,116 INFO [StoreOpener-0b19753c89c8b3102c90fe9143d5e4a4-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 04:18:34,178 INFO [StoreOpener-0b19753c89c8b3102c90fe9143d5e4a4-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 04:18:34,326 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 0b19753c89c8b3102c90fe9143d5e4a4; next sequenceid=2 2018-05-02 04:18:34,445 INFO [PostOpenDeployTasks:0b19753c89c8b3102c90fe9143d5e4a4] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525234712010.0b19753c89c8b3102c90fe9143d5e4a4. 2018-05-02 04:18:36,266 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:acl,,1525234715375.210c9765f6ad8c0a8fa5c08191c03b7e. 2018-05-02 04:18:36,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 04:18:36,339 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 04:18:36,339 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 04:18:36,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 04:18:36,339 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 04:18:36,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 04:18:36,372 INFO [StoreOpener-210c9765f6ad8c0a8fa5c08191c03b7e-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:18:36,374 INFO [StoreOpener-210c9765f6ad8c0a8fa5c08191c03b7e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 04:18:36,379 INFO [StoreOpener-210c9765f6ad8c0a8fa5c08191c03b7e-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 04:18:36,425 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 210c9765f6ad8c0a8fa5c08191c03b7e; next sequenceid=2 2018-05-02 04:18:36,428 INFO [PostOpenDeployTasks:210c9765f6ad8c0a8fa5c08191c03b7e] regionserver.HRegionServer: Post open deploy tasks for hbase:acl,,1525234715375.210c9765f6ad8c0a8fa5c08191c03b7e. 2018-05-02 04:18:38,616 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 04:18:38,617 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 04:18:38,618 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 04:18:38,920 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:18:38,921 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:18:38,924 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:18:38,991 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@6a13c5b3 2018-05-02 04:18:38,993 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:18:38,994 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:18:38,995 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 04:18:39,000 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b2790015, negotiated timeout = 10000 2018-05-02 04:18:39,036 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 04:18:39,046 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 04:18:39,434 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:18:39,713 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:18:39,713 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:18:39,721 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: No suitable collector found. 2018-05-02 04:18:39,727 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:18:39,730 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:18:39,730 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:18:55,950 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1e03fd3f] zookeeper.ZooKeeper: Session: 0x2631f08d939000d closed 2018-05-02 04:18:55,951 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x1e03fd3f-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 04:18:56,960 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.097 minutes, events=2, succcessCount=1, totalEvents=2, totalSuccessCount=1 2018-05-02 04:19:49,741 INFO [timeline] timeline.HadoopTimelineMetricsSink: No live collector to send metrics to. Metrics to be sent will be discarded. This message will be skipped for the next 20 times. 2018-05-02 04:21:02,183 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 04:21:09,845 INFO [timeline] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:23:37,562 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "hbase:namespace,,1525234712010.0b19753c89c8b3102c90fe9143d5e4a4." 2018-05-02 04:23:37,562 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 0b19753c89c8b3102c90fe9143d5e4a4, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460. Requested from /172.27.59.154 2018-05-02 04:23:37,587 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:23:37,588 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=78 B memstore heap size=232 B 2018-05-02 04:23:37,852 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/0b19753c89c8b3102c90fe9143d5e4a4/.tmp/info/98713008c48f44e9b517ef475e75f07a 2018-05-02 04:23:38,079 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/namespace/0b19753c89c8b3102c90fe9143d5e4a4/info/98713008c48f44e9b517ef475e75f07a, entries=2, sequenceid=6, filesize=4.8 K 2018-05-02 04:23:38,102 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Finished memstore flush; data size ~78 B/78, heap size ~448 B/448, currentsize=0 B/0 for 0b19753c89c8b3102c90fe9143d5e4a4 in 514ms, sequenceid=6, compaction requested=false 2018-05-02 04:23:38,155 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed hbase:namespace,,1525234712010.0b19753c89c8b3102c90fe9143d5e4a4. 2018-05-02 04:23:38,156 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding 0b19753c89c8b3102c90fe9143d5e4a4 move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525234590460 record at close sequenceid=6 2018-05-02 04:23:38,917 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:23:38,922 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:23:38,923 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:23:39,432 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:23:39,752 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:23:39,753 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:23:39,838 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:23:39,838 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:23:39,838 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:23:39,845 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:23:39,848 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:23:39,848 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:23:41,988 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=05:45.356 minutes, events=1, succcessCount=1, totalEvents=1, totalSuccessCount=1 2018-05-02 04:23:56,988 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.013 minutes, events=4, succcessCount=2, totalEvents=6, totalSuccessCount=3 2018-05-02 04:24:06,712 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=2; newVersion=4 2018-05-02 04:24:06,719 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:24:06,719 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:24:06,720 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:24:56,995 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.007 minutes, events=4, succcessCount=2, totalEvents=10, totalSuccessCount=5 2018-05-02 04:26:02,181 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 04:28:38,917 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:28:38,921 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:28:38,921 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:28:39,427 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:28:39,640 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:28:39,640 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:28:39,708 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:28:39,708 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:28:39,708 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:28:39,713 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:28:39,715 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:28:39,715 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:29:54,015 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=06:12.027 minutes, events=4, succcessCount=4, totalEvents=5, totalSuccessCount=5 2018-05-02 04:29:57,016 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.009 minutes, events=4, succcessCount=2, totalEvents=14, totalSuccessCount=7 2018-05-02 04:30:07,483 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=4; newVersion=6 2018-05-02 04:30:07,492 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:30:07,492 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:30:07,493 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:31:02,181 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 04:33:03,042 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=03:09.027 minutes, events=2, succcessCount=2, totalEvents=7, totalSuccessCount=7 2018-05-02 04:33:07,817 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=6; newVersion=10 2018-05-02 04:33:07,826 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:33:07,826 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:33:07,826 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:33:38,918 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:33:38,925 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:33:38,928 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:33:39,434 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:33:39,731 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:33:39,732 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:33:39,865 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:33:39,865 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:33:39,865 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:33:39,876 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:33:39,879 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:33:39,879 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:33:57,046 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=8, succcessCount=4, totalEvents=22, totalSuccessCount=11 2018-05-02 04:35:38,117 ERROR [Thread-24] client.RangerAdminRESTClient: Error getting policies for serviceName=cl1_hbaseresponse=null com.sun.jersey.api.client.ClientHandlerException: java.net.ConnectException: Connection refused (Connection refused) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) at com.sun.jersey.api.client.Client.handle(Client.java:652) at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) at com.sun.jersey.api.client.WebResource$Builder.get(WebResource.java:509) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:120) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:171) Caused by: java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:673) at sun.net.NetworkClient.doConnect(NetworkClient.java:175) at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) at sun.net.www.protocol.https.HttpsClient.(HttpsClient.java:264) at sun.net.www.protocol.https.HttpsClient.New(HttpsClient.java:367) at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(AbstractDelegateHttpsURLConnection.java:191) at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1156) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:177) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:347) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ... 13 more 2018-05-02 04:36:02,181 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=119, evicted=0, evictedPerRun=0.0 2018-05-02 04:36:38,155 ERROR [Thread-24] client.RangerAdminRESTClient: Error getting policies for serviceName=cl1_hbaseresponse=null com.sun.jersey.api.client.ClientHandlerException: java.net.SocketTimeoutException: Read timed out at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) at com.sun.jersey.api.client.Client.handle(Client.java:652) at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) at com.sun.jersey.api.client.WebResource$Builder.get(WebResource.java:509) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:120) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.run(PolicyRefresher.java:171) Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:171) at java.net.SocketInputStream.read(SocketInputStream.java:141) at sun.security.ssl.InputRecord.readFully(InputRecord.java:465) at sun.security.ssl.InputRecord.read(InputRecord.java:503) at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983) at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1385) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1413) at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1397) at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:559) at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185) at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1564) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) at sun.net.www.protocol.https.HttpsURLConnectionImpl.getResponseCode(HttpsURLConnectionImpl.java:347) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ... 13 more 2018-05-02 04:38:38,918 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:38:38,921 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:38:38,933 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:38:39,438 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:38:39,744 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:38:39,744 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:38:39,832 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:38:39,832 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:38:39,832 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:38:39,844 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:38:39,846 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:38:39,846 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:40:08,990 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=10; newVersion=11 2018-05-02 04:40:09,002 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=37; leafNodeCount=2; singleChildNodeCount=34; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=1; evaluatorListRefCount=35; wildcardEvaluatorListRefCount=36 2018-05-02 04:40:09,003 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:40:09,003 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:40:09,090 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=07:06.048 minutes, events=4, succcessCount=4, totalEvents=11, totalSuccessCount=11 2018-05-02 04:40:57,096 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.006 minutes, events=2, succcessCount=1, totalEvents=24, totalSuccessCount=12 2018-05-02 04:41:02,181 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=149, evicted=0, evictedPerRun=0.0 2018-05-02 04:43:38,918 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:43:38,920 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:43:38,923 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:43:39,429 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:43:39,673 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:43:39,674 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:43:39,753 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:43:39,753 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:43:39,753 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:43:39,759 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:43:39,762 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:43:39,762 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:46:02,181 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=179, evicted=0, evictedPerRun=0.0 2018-05-02 04:47:40,077 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=11; newVersion=13 2018-05-02 04:47:40,084 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=44; leafNodeCount=3; singleChildNodeCount=40; maxDepth=26; evaluatorListCount=2; wildcardEvaluatorListCount=2; evaluatorListRefCount=42; wildcardEvaluatorListRefCount=42 2018-05-02 04:47:40,084 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:47:40,084 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:48:38,919 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:48:38,921 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:48:38,927 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:48:39,435 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:48:40,297 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:48:40,297 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:48:40,391 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:48:40,392 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:48:40,392 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:48:40,404 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:48:40,410 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:48:40,410 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:51:02,181 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=209, evicted=0, evictedPerRun=0.0 2018-05-02 04:53:38,919 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:53:38,922 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:53:38,928 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:53:39,433 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:53:39,677 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:53:39,677 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:53:39,725 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:53:39,725 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:53:39,725 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:53:39,728 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:53:39,730 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:53:39,730 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:55:40,848 INFO [Thread-24] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=13; newVersion=14 2018-05-02 04:55:40,857 INFO [Thread-24] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 04:55:40,857 INFO [Thread-24] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:55:40,857 INFO [Thread-24] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:56:02,188 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=239, evicted=0, evictedPerRun=0.0 Wed May 2 04:56:14 UTC 2018 Terminating regionserver 2018-05-02 04:56:14,511 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 04:56:14,511 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 04:56:14,512 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 04:56:14,512 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 04:56:14,512 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 04:56:14,512 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 04:56:14,512 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 04:56:14,512 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 04:56:14,512 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,512 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 04:56:14,512 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 04:56:14,512 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 04:56:14,512 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,512 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 04:56:14,513 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,513 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 2 milli seconds 2018-05-02 04:56:14,513 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 04:56:14,513 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,513 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,513 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,513 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 04:56:14,513 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 04:56:14,514 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,514 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:56:14,514 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,514 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,514 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 04:56:14,514 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=16:05.424 minutes, events=1, succcessCount=1, totalEvents=12, totalSuccessCount=12 2018-05-02 04:56:14,514 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:56:14,514 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 04:56:14,515 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 04:56:14,515 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@3c46dcbe 2018-05-02 04:56:14,515 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384' ***** 2018-05-02 04:56:14,516 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:56:14,517 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 04:56:14,518 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 04:56:14,518 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 04:56:14,519 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 04:56:14,519 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384 exiting 2018-05-02 04:56:14,545 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@57272109{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 04:56:14,555 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] server.AbstractConnector: Stopped ServerConnector@2cc75074{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 04:56:14,556 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@1229a2b7{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 04:56:14,556 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@66273da0{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 04:56:14,563 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 04:56:14,564 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 04:56:14,564 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 04:56:14,564 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 04:56:14,564 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 04:56:14,565 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:56:14,565 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384 2018-05-02 04:56:14,566 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 04:56:14,566 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x1e03fd3f to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 04:56:14,566 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 1 regions to close 2018-05-02 04:56:14,627 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed hbase:acl,,1525234715375.210c9765f6ad8c0a8fa5c08191c03b7e. 2018-05-02 04:56:14,766 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384; all regions closed. 2018-05-02 04:56:14,810 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525234553384:(num 1525234691455) 2018-05-02 04:56:14,811 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Leases: Closed leases 2018-05-02 04:56:14,812 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 had [[ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384 Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 04:56:14,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 04:56:14,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 04:56:14,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 04:56:14,813 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 04:56:14,815 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.NettyRpcServer: Stopping server on /172.27.70.95:16020 2018-05-02 04:56:14,815 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 04:56:14,871 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ZooKeeper: Session: 0x1631f08b26c001e closed 2018-05-02 04:56:14,871 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 04:56:14,871 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525234553384; zookeeper connection closed. 2018-05-02 04:56:14,872 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 04:56:14,873 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 04:57:49 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000002.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1031588 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 04:57:51,465 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 04:57:51,468 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 04:57:51,468 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 04:57:51,468 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 04:57:51,468 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 04:57:51,884 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 04:57:51,884 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 04:57:51,884 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 04:57:51,884 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 04:57:51,886 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 04:57:51,886 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 04:57:51,887 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 04:57:51,887 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:57:51,887 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 04:57:51,887 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 04:57:51,887 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 04:57:51,887 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:57:51,887 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 04:57:51,887 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 04:57:51,887 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 04:57:51,887 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 04:57:51,888 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 04:57:51,888 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 04:57:51,888 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 04:57:51,888 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 04:57:51,888 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 04:57:51,888 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 04:57:51,888 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 04:57:51,888 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 04:57:51,888 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 04:57:51,889 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 04:57:51,889 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 04:57:51,889 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020457 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 04:57:51,889 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 04:57:51,889 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 04:57:51,889 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 04:57:51,889 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log 2018-05-02 04:57:51,889 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 04:57:51,889 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=409596 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 04:57:51,890 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 04:57:51,892 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 04:57:51,894 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020457 2018-05-02 04:57:51,894 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 04:57:51,894 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 04:57:51,894 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:57:51,894 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 04:57:51,894 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 04:57:51,894 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 04:57:51,894 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 04:57:51,894 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 04:57:51,895 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 04:57:51,898 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 04:57:51,898 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020457, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 04:57:52,673 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 04:57:52,750 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:57:53,439 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:57:53,444 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:57:53,972 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:57:53,972 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:57:53,972 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:57:54,039 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:57:54,265 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:57:54,265 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:57:54,317 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 04:57:54,737 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 server-side Connection retries=105 2018-05-02 04:57:54,762 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:57:54,765 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 04:57:54,765 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 04:57:54,766 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 04:57:54,766 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:57:54,766 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 04:57:55,011 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 04:57:55,278 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 04:57:55,416 INFO [main] ipc.NettyRpcServer: Bind to /172.27.70.95:16020 2018-05-02 04:57:55,589 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 04:57:55,594 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=819.20 MB, blockSize=64 KB 2018-05-02 04:57:55,620 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:57:55,623 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:57:57,061 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:57:57,082 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 04:57:57,172 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 04:57:57,180 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 04:57:57,181 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:57:57,181 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 04:57:57,181 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 04:57:57,181 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 04:57:57,181 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 04:57:57,182 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 04:57:57,182 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 04:57:57,182 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 04:57:57,182 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 04:57:57,182 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 04:57:57,182 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=4.15.12-1.el7.elrepo.x86_64 2018-05-02 04:57:57,182 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 04:57:57,182 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 04:57:57,182 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 04:57:57,184 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 04:57:57,225 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 04:57:57,229 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 04:57:57,237 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:57:57,249 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:57:57,254 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 04:57:57 UTC 2018 2018-05-02 04:57:57,254 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 04:57:57 UTC 2018 2018-05-02 04:57:57,255 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 00:59:09 UTC 2018 2018-05-02 04:57:57,258 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 04:57:57,272 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b279004a, negotiated timeout = 90000 2018-05-02 04:57:57,388 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949 2018-05-02 04:57:57,622 INFO [main] util.log: Logging initialized @7112ms 2018-05-02 04:57:57,725 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 04:57:57,742 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 04:57:57,742 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 04:57:57,745 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 04:57:57,746 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 04:57:57,746 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 04:57:57,790 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 04:57:57,792 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 04:57:57,918 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 04:57:57,918 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 04:57:58,163 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 04:57:58,170 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000002.hwx.site,h=[ctr-e138-1518143905142-279227-01-000002.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 04:57:58,188 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 04:57:58,188 INFO [main] server.Server: Started @7678ms 2018-05-02 04:57:58,220 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 04:57:58,335 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Connect 0x6e3f2163 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 04:57:58,354 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x6e3f2163] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/1907289185@34ac7c30 2018-05-02 04:57:58,359 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x6e3f2163-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 04:57:58,361 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x6e3f2163-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 04:57:58,362 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x6e3f2163-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 04:57:58,366 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x6e3f2163-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c0084, negotiated timeout = 90000 2018-05-02 04:57:58,462 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 04:57:58,462 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 04:57:58,485 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 04:57:58,485 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 04:57:58,485 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:57:58,485 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 04:57:58,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:57:58,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 04:57:58,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:57:58,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 04:57:58,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 04:57:58,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 04:57:58,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 04:57:58,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 04:57:58,686 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 04:57:58,690 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 04:57:58,691 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 04:57:58,694 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 04:57:58,694 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 04:57:58,732 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 04:57:58,733 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 04:57:58,733 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 04:57:58,742 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 04:57:58,742 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: init() called 2018-05-02 04:57:58,742 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:57:58,742 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 04:57:58,742 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 04:57:58,743 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 04:57:58,743 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 04:57:58,743 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:57:58,743 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 04:57:58,751 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 04:57:58,752 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 04:57:58,752 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 04:57:58,752 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 04:57:58,790 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 04:57:58,816 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 04:57:58,816 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 04:57:58,818 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:57:58,818 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:57:58,818 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 04:57:58,818 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 04:57:58,818 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 04:57:58,823 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 04:57:58,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 04:57:58,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 04:57:58,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 04:57:58,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 04:57:58,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 04:57:58,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 04:57:58,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 04:57:58,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 04:57:58,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 04:57:58,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 04:57:58,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 04:57:58,825 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 04:57:58,826 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:57:58,826 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:57:58,827 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 04:57:58,827 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 04:57:58,827 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 04:57:58,827 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 04:57:58,828 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 04:57:58,828 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 04:57:58,828 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 04:57:58,828 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 04:57:58,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 04:57:58,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 04:57:58,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 04:57:58,833 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 04:57:58,837 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 04:57:58,837 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 04:57:58,969 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:57:59,256 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 04:58:01,187 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=14 2018-05-02 04:58:01,334 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 04:58:01,335 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:58:01,336 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 04:58:01,337 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 04:58:01,337 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 04:58:01,351 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525237056151 with port=16020, startcode=1525237071949 2018-05-02 04:58:01,768 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 04:58:02,032 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 04:58:02,072 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=778.2 M, Offheap=false 2018-05-02 04:58:02,081 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 04:58:02,084 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 04:58:02,103 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 04:58:02,302 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949 starting 2018-05-02 04:58:02,307 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 04:58:02,315 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 04:58:02,317 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 04:58:02,322 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237069928, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949] other RSs: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237069928, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949] 2018-05-02 04:58:02,363 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949, RpcServer on ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:16020, sessionid=0x3631f08b279004a 2018-05-02 04:58:02,366 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 04:58:02,366 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 04:58:04,302 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 04:58:05,434 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525237071949, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 04:58:05,978 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Slow sync cost: 422 ms, current pipeline: [] 2018-05-02 04:58:05,979 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525237071949.1525237085434 2018-05-02 04:58:19,988 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 04:58:19,996 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 04:58:20,018 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525237071949.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 04:58:20,116 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525237071949.meta.1525237100018.meta 2018-05-02 04:58:20,321 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 04:58:20,330 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 04:58:20,330 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 04:58:20,330 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 04:58:20,331 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 04:58:20,332 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 04:58:20,343 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 04:58:20,564 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:58:20,597 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 04:58:20,631 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 04:58:20,646 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=615.39 KB, freeSize=818.60 MB, maxSize=819.20 MB, heapSize=615.39 KB, minSize=778.24 MB, minFactor=0.95, multiSize=389.12 MB, multiFactor=0.5, singleSize=194.56 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 04:58:20,647 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 04:58:20,655 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 04:58:20,779 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=3 2018-05-02 04:58:20,847 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 04:58:24,295 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 04:58:24,377 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 04:58:24,377 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-02 04:58:24,379 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 04:58:25,382 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 04:58:25,385 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 04:58:25,388 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 04:58:25,933 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 04:58:26,405 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 04:58:26,406 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 04:58:26,489 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 04:58:26,489 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 04:58:26,490 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 04:58:26,496 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 04:58:26,498 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 04:58:26,498 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 04:58:58,498 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x6e3f2163] zookeeper.ZooKeeper: Session: 0x1631f08b26c0084 closed 2018-05-02 04:58:58,499 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x6e3f2163-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:01:01,816 INFO [Thread-22] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=14; newVersion=18 2018-05-02 05:01:01,827 INFO [Thread-22] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:01:01,827 INFO [Thread-22] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:01:01,828 INFO [Thread-22] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:02:35,790 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:02:35,797 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 1 failover attempts. Trying to failover after sleeping for 924ms. 2018-05-02 05:02:36,724 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 2 failover attempts. Trying to failover after sleeping for 1313ms. 2018-05-02 05:02:38,040 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 3 failover attempts. Trying to failover after sleeping for 3075ms. 2018-05-02 05:02:41,117 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 4 failover attempts. Trying to failover after sleeping for 6007ms. 2018-05-02 05:02:47,127 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 5 failover attempts. Trying to failover after sleeping for 13224ms. 2018-05-02 05:02:55,604 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:03:00,354 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 6 failover attempts. Trying to failover after sleeping for 19150ms. 2018-05-02 05:03:19,509 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 7 failover attempts. Trying to failover after sleeping for 8246ms. 2018-05-02 05:03:23,021 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 224953ms 2018-05-02 05:03:25,380 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:03:25,382 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:03:25,385 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:03:25,897 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:03:26,422 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:03:26,423 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:03:26,562 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:03:26,562 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:03:26,562 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:03:26,573 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:03:26,579 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:03:26,579 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:03:27,761 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Trying to failover after sleeping for 18961ms. 2018-05-02 05:03:32,241 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 89910ms 2018-05-02 05:03:43,182 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 230480ms 2018-05-02 05:03:46,749 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 9 failover attempts. Trying to failover after sleeping for 21095ms. 2018-05-02 05:03:52,280 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3337ms 2018-05-02 05:04:02,209 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 235607ms 2018-05-02 05:04:07,871 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1663276075_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1663276075_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 12602ms. 2018-05-02 05:04:12,215 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 126712ms 2018-05-02 05:04:20,478 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1663276075_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1663276075_1. Name node is in safe mode. The reported blocks 159 needs additional 32 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 10127ms. 2018-05-02 05:04:22,609 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 45841ms 2018-05-02 05:04:30,619 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1663276075_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1663276075_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 18757ms. 2018-05-02 05:04:32,472 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 193079ms 2018-05-02 05:04:43,149 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 6306ms 2018-05-02 05:04:49,384 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1663276075_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1663276075_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 9404ms. 2018-05-02 05:04:52,859 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 80241ms 2018-05-02 05:04:58,794 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1663276075_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_1663276075_1. Name node is in safe mode. The reported blocks 176 needs additional 15 blocks to reach the threshold 1.0000 of total blocks 191. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 8898ms. 2018-05-02 05:05:02,211 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 190118ms 2018-05-02 05:05:12,629 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 189113ms 2018-05-02 05:05:22,249 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 82550ms 2018-05-02 05:05:32,417 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 3460ms 2018-05-02 05:05:42,213 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 295280ms 2018-05-02 05:05:52,208 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 232938ms 2018-05-02 05:06:02,208 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 132245ms 2018-05-02 05:06:12,591 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 43274ms 2018-05-02 05:06:22,284 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 237926ms 2018-05-02 05:06:32,629 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 151078ms 2018-05-02 05:06:43,094 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 272108ms 2018-05-02 05:06:52,208 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 107434ms 2018-05-02 05:07:02,315 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] regionserver.HRegionServer: MemstoreFlusherChore requesting flush of hbase:meta,,1.1588230740 because info has an old edit so flush to free WALs after random delay 263363ms 2018-05-02 05:07:07,982 INFO [MemStoreFlusher.0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:07:07,987 INFO [MemStoreFlusher.0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=11.51 KB memstore heap size=19.39 KB 2018-05-02 05:07:08,399 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed memstore data size=10.64 KB at sequenceid=53 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/fa4e1c43f8fb4fa2b4ad7d9e0f1cf2cd 2018-05-02 05:07:08,871 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed memstore data size=892 B at sequenceid=53 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/table/618c71bde59546ea9102d2ca41aa2636 2018-05-02 05:07:08,984 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/fa4e1c43f8fb4fa2b4ad7d9e0f1cf2cd, entries=52, sequenceid=53, filesize=11.2 K 2018-05-02 05:07:09,086 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/618c71bde59546ea9102d2ca41aa2636, entries=9, sequenceid=53, filesize=5.0 K 2018-05-02 05:07:09,091 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush; data size ~11.51 KB/11788, heap size ~19.81 KB/20288, currentsize=0 B/0 for 1588230740 in 1104ms, sequenceid=53, compaction requested=false 2018-05-02 05:07:10,942 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@5622cb97 2018-05-02 05:07:10,950 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:07:10,969 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:07:10,972 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 05:07:10,975 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b2790065, negotiated timeout = 10000 2018-05-02 05:07:11,062 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:07:11,075 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:07:55,603 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=615.39 KB, freeSize=818.60 MB, max=819.20 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 05:07:58,885 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.008 minutes, events=2, succcessCount=1, totalEvents=2, totalSuccessCount=1 2018-05-02 05:08:17,453 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398 znode expired, triggering replicatorRemoved event 2018-05-02 05:08:17,483 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341 znode expired, triggering replicatorRemoved event 2018-05-02 05:08:17,898 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237069928 znode expired, triggering replicatorRemoved event 2018-05-02 05:08:18,146 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. Wed May 2 05:08:18 UTC 2018 Terminating regionserver 2018-05-02 05:08:18,186 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 05:08:18,186 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 05:08:18,186 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 05:08:18,186 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 05:08:18,186 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 05:08:18,186 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 05:08:18,187 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 05:08:18,187 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:08:18,187 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1 milli seconds 2018-05-02 05:08:18,187 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:18,187 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 05:08:18,187 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 05:08:18,187 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 05:08:18,187 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 05:08:18,187 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 05:08:18,187 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:08:18,187 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 05:08:18,187 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 05:08:18,188 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 05:08:18,188 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949' ***** 2018-05-02 05:08:18,188 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:18,188 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 05:08:18,188 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 05:08:18,188 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 05:08:18,188 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:18,188 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 05:08:18,188 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:18,188 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:18,188 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:18,189 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:07.311 minutes, events=1, succcessCount=1, totalEvents=1, totalSuccessCount=1 2018-05-02 05:08:18,189 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:08:18,189 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 05:08:18,189 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:08:18,190 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:08:18,192 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 05:08:18,195 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 05:08:18,195 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 05:08:18,196 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 05:08:18,196 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949 exiting 2018-05-02 05:08:18,214 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:08:18,220 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:08:18,220 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 05:08:18,221 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 05:08:18,233 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 05:08:18,234 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 05:08:18,234 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 05:08:18,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 05:08:18,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949 2018-05-02 05:08:18,235 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x6e3f2163 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:08:18,238 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 05:08:18,239 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 05:08:18,239 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 05:08:18,239 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 05:08:18,239 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:08:18,241 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 1 regions to close 2018-05-02 05:08:18,243 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:08:18,244 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=842 B memstore heap size=856 B 2018-05-02 05:08:18,318 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:08:18,430 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=842 B at sequenceid=58 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/489cc049fa6246029960af509120617e 2018-05-02 05:08:18,611 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/489cc049fa6246029960af509120617e, entries=6, sequenceid=58, filesize=5.5 K 2018-05-02 05:08:18,615 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Finished memstore flush; data size ~842 B/842, heap size ~1.47 KB/1504, currentsize=0 B/0 for 1588230740 in 371ms, sequenceid=58, compaction requested=false 2018-05-02 05:08:18,740 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2018-05-02 05:08:18,842 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949; all regions closed. 2018-05-02 05:08:18,957 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525237071949.meta:.meta(num 1525237100018) 2018-05-02 05:08:19,034 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525237071949:(num 1525237085434) 2018-05-02 05:08:19,037 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Leases: Closed leases 2018-05-02 05:08:19,042 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949 Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 05:08:19,043 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 05:08:19,047 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.NettyRpcServer: Stopping server on /172.27.70.95:16020 2018-05-02 05:08:19,047 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 05:08:19,187 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ZooKeeper: Session: 0x3631f08b279004a closed 2018-05-02 05:08:19,187 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:08:19,187 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949; zookeeper connection closed. 2018-05-02 05:08:19,188 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 05:08:19,193 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 05:09:32 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000002.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1031588 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 05:09:36,376 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 05:09:36,380 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 05:09:36,381 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 05:09:36,381 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 05:09:36,381 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 05:09:37,165 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 05:09:37,165 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 05:09:37,165 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 05:09:37,165 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:09:37,167 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 05:09:37,167 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 05:09:37,167 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 05:09:37,167 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:09:37,167 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 05:09:37,167 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 05:09:37,167 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 05:09:37,167 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:09:37,167 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 05:09:37,167 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 05:09:37,168 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 05:09:37,168 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 05:09:37,168 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 05:09:37,168 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 05:09:37,168 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 05:09:37,168 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 05:09:37,168 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 05:09:37,168 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 05:09:37,168 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:09:37,168 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 05:09:37,169 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 05:09:37,169 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 05:09:37,169 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 05:09:37,169 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020509 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 05:09:37,169 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 05:09:37,169 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 05:09:37,169 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 05:09:37,169 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log 2018-05-02 05:09:37,170 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 05:09:37,170 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 05:09:37,170 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 05:09:37,170 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 05:09:37,170 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=409596 2018-05-02 05:09:37,170 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:09:37,170 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 05:09:37,170 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 05:09:37,170 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 05:09:37,171 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 05:09:37,171 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:09:37,171 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 05:09:37,171 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 05:09:37,172 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:09:37,173 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020509 2018-05-02 05:09:37,173 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 05:09:37,173 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 05:09:37,174 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:09:37,174 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 05:09:37,174 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 05:09:37,174 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 05:09:37,174 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 05:09:37,174 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 05:09:37,174 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 05:09:37,177 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 05:09:37,177 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020509, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 05:09:37,408 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:09:38,120 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 05:09:38,202 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:09:39,205 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:09:39,212 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:09:40,078 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:09:40,078 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:09:40,078 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:09:40,294 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:09:40,614 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:09:40,614 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:09:40,710 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 05:09:42,243 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 server-side Connection retries=105 2018-05-02 05:09:42,293 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:09:42,296 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 05:09:42,296 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 05:09:42,297 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 05:09:42,297 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:09:42,297 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:09:42,574 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 05:09:43,083 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 05:09:43,277 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 05:09:43,708 INFO [main] ipc.NettyRpcServer: Bind to /172.27.70.95:16020 2018-05-02 05:09:44,585 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 05:09:44,589 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:09:44,592 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 05:09:44,636 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:09:44,638 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:09:44,655 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 05:09:48,805 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:09:48,866 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:09:49,145 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:09:49,193 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 05:09:49,194 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:09:49,194 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 05:09:49,194 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 05:09:49,194 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 05:09:49,194 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 05:09:49,209 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:09:49,209 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 05:09:49,209 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 05:09:49,209 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 05:09:49,209 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 05:09:49,209 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=4.15.12-1.el7.elrepo.x86_64 2018-05-02 05:09:49,209 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 05:09:49,209 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 05:09:49,209 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 05:09:49,211 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 05:09:49,377 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 05:09:49,388 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 05:09:49,404 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:09:49,439 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:09:49,477 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 05:09:49 UTC 2018 2018-05-02 05:09:49,477 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 05:09:49 UTC 2018 2018-05-02 05:09:49,477 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 00:59:03 UTC 2018 2018-05-02 05:09:49,483 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:09:49,502 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390065, negotiated timeout = 90000 2018-05-02 05:09:49,509 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 05:09:49,510 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390065 connected 2018-05-02 05:09:49,591 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390065, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 05:09:49,928 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:09:49,950 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:09:50,298 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 05:09:50,374 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 05:09:50,386 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 05:09:50,443 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 05:09:50,516 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 05:09:51,128 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 05:09:51,129 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 05:09:51,129 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 05:09:51,613 INFO [main] util.log: Logging initialized @16646ms 2018-05-02 05:09:51,771 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 05:09:51,801 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 05:09:51,802 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 05:09:51,805 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 05:09:51,806 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 05:09:51,806 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 05:09:51,860 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 05:09:51,863 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 05:09:51,970 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@26cb5207{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 05:09:51,971 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 05:09:52,623 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@71e4b308{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:09:52,662 INFO [main] ssl.SslContextFactory: x509=X509@4cc36c19(ctr-e138-1518143905142-279227-01-000002.hwx.site,h=[ctr-e138-1518143905142-279227-01-000002.hwx.site],w=[]) for SslContextFactory@5a3a1bf9(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 05:09:52,695 INFO [main] server.AbstractConnector: Started ServerConnector@51ec2856{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:09:52,695 INFO [main] server.Server: Started @17738ms 2018-05-02 05:09:52,754 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 05:09:52,767 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 05:09:52,815 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 05:09:52,815 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 05:09:52,825 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 05:09:52,896 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Connect 0x12c8ef07 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 05:09:52,914 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x12c8ef07] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1745506327@2d08d372 2018-05-02 05:09:52,936 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x12c8ef07-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:09:52,938 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x12c8ef07-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:09:52,944 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x12c8ef07-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:09:52,954 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x12c8ef07-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390066, negotiated timeout = 90000 2018-05-02 05:09:53,078 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64303996, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 05:09:53,090 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5142c1e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:0 2018-05-02 05:09:53,099 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000002:16020 2018-05-02 05:09:53,115 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 05:09:53,116 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 05:09:53,140 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 05:09:53,140 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 05:09:53,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:53,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 05:09:53,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:53,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 05:09:53,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:53,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 05:09:53,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 05:09:53,141 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 05:09:53,142 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:09:53,142 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 05:09:53,390 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 05:09:53,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 05:09:53,401 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 05:09:53,402 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 05:09:53,407 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 05:09:53,407 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 05:09:53,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 05:09:53,481 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 05:09:53,482 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 05:09:53,482 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 05:09:53,482 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 05:09:53,482 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 05:09:53,482 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 05:09:53,494 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 05:09:53,495 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: init() called 2018-05-02 05:09:53,495 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:53,495 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 05:09:53,495 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 05:09:53,496 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 05:09:53,496 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 05:09:53,496 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:09:53,496 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 05:09:53,506 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:09:53,506 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 05:09:53,506 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 05:09:53,506 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:09:53,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 05:09:53,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 05:09:53,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 05:09:53,610 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:09:53,610 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:53,610 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 05:09:53,610 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 05:09:53,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 05:09:53,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 05:09:53,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 05:09:53,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 05:09:53,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 05:09:53,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 05:09:53,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 05:09:53,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 05:09:53,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 05:09:53,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 05:09:53,622 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 05:09:53,623 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 05:09:53,623 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 05:09:53,623 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 05:09:53,624 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:09:53,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:53,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 05:09:53,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 05:09:53,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 05:09:53,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 05:09:53,626 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:09:53,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:09:53,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 05:09:53,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 05:09:53,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 05:09:53,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 05:09:53,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 05:09:53,638 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:09:53,656 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 05:09:53,661 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:09:53,929 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:09:54,009 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390065, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:09:54,011 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:09:54,012 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390065, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:09:54,014 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:09:54,014 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:09:54,015 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390065, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/1 2018-05-02 05:09:54,017 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:09:54,527 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:10:00,650 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:10:00,651 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 05:10:02,076 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 05:10:02,708 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:10:02,714 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:10:02,716 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:10:02,725 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 05:10:02,725 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 05:10:02,761 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525237764081 with port=16020, startcode=1525237777223 2018-05-02 05:10:03,146 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:10:03,146 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:10:03,148 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:10:03,333 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:10:03,379 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:10:03,427 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:10:03,430 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:10:03,433 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:10:03,434 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:10:03,434 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:10:03,514 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 05:10:03,514 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 05:10:03,514 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 05:10:03,661 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:10:03,707 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:10:04,427 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 05:10:04,445 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 05:10:04,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 05:10:04,551 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 05:10:04,558 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 05:10:04,584 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 05:10:04,978 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:10:04,978 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:10:04,979 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:10:04,979 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:10:04,979 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:10:04,979 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 05:10:04,979 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 05:10:04,982 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:10:05,103 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 starting 2018-05-02 05:10:05,104 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:10:05,109 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 05:10:05,113 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:10:05,118 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 05:10:05,125 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 05:10:05,164 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237070398, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237078341, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237076568, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237780568, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237071949, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237069928, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134] other RSs: [ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237780568, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134] 2018-05-02 05:10:05,260 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223, RpcServer on ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:16020, sessionid=0x2631f08d9390065 2018-05-02 05:10:05,260 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 05:10:05,261 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:10:05,261 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223' 2018-05-02 05:10:05,261 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 05:10:05,262 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 05:10:05,262 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 05:10:05,263 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 05:10:05,263 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:10:05,263 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223' 2018-05-02 05:10:05,263 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 05:10:05,263 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 05:10:05,264 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 05:10:05,264 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 05:10:05,264 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 05:10:08,386 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525237777223, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:10:09,037 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Slow sync cost: 457 ms, current pipeline: [] 2018-05-02 05:10:09,037 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525237777223.1525237808387 2018-05-02 05:10:09,038 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:10:09,391 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:10:09,396 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:10:09,396 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:10:09,404 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:10:09,415 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:10:09,416 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:10:09,418 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:10:09,419 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:10:09,420 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:10:09,529 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:10:09,869 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:10:09,904 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 8dc6fd2022c2fdf8c065fbd16cadaaca, NAME => 'ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca.', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:10:09,904 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:10:09,962 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 05:10:09,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AuthenticationService 2018-05-02 05:10:09,966 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:10:09,966 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:10:09,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 05:10:09,971 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=SecureBulkLoadService 2018-05-02 05:10:09,971 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:10:09,971 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:10:09,971 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:10:09,971 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:10:09,971 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:10:09,971 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:10:09,972 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AccessControlService 2018-05-02 05:10:09,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 05:10:09,973 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:10:09,973 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:10:09,973 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:10:09,973 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:10:10,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 05:10:10,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:10:10,002 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table ATLAS_ENTITY_AUDIT_EVENTS 8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 05:10:10,003 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:10:10,043 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2018-05-02 05:10:10,045 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 05:10:10,059 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:10:10,147 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 05:10:10,147 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 05:10:10,153 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 05:10:10,153 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 05:10:10,191 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:10:10,194 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] hfile.CacheConfig: Created cacheConfig for dt: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:10:10,210 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:10:10,210 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:10:10,450 INFO [StoreFileOpenerThread-dt-1] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 05:10:10,497 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/9a15d9bb66554f11aa0429ce82724413 2018-05-02 05:10:10,498 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 05:10:10,502 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:10:10,521 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: Store=dt, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:10:10,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 05:10:10,580 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 05:10:10,650 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:10:10,650 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 05:10:10,659 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=20 2018-05-02 05:10:10,668 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 8dc6fd2022c2fdf8c065fbd16cadaaca; next sequenceid=21 2018-05-02 05:10:10,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=9 2018-05-02 05:10:10,681 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=10 2018-05-02 05:10:10,702 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:10:10,703 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 05:10:10,703 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:10:10,703 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 05:10:10,749 INFO [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Post open deploy tasks for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:10:10,750 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:10:10,802 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:10:10,804 DEBUG [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Finished post open deploy task for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:10:10,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:10:10,805 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:10:14,251 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:10:14,253 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:10:14,253 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:10:14,255 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:10:14,257 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:10:14,257 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:10:14,258 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:10:14,258 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:10:14,258 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:10:14,677 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@59a4bc9b 2018-05-02 05:10:14,678 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:10:14,679 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:10:14,679 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 05:10:14,683 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00a8, negotiated timeout = 10000 2018-05-02 05:10:14,708 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:10:14,714 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:10:15,002 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:10:15,004 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:10:15,006 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:10:15,512 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:10:15,815 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:10:15,816 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:10:15,891 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:10:15,892 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:10:15,892 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:10:15,898 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:10:15,901 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:10:15,901 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:10:16,527 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:10:16,527 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:10:53,000 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x12c8ef07] zookeeper.ZooKeeper: Session: 0x2631f08d9390066 closed 2018-05-02 05:10:53,001 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x12c8ef07-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:10:53,678 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.068 minutes, events=2, succcessCount=1, totalEvents=2, totalSuccessCount=1 2018-05-02 05:11:09,761 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:09,787 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:09,787 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 05:11:09,787 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:09,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 05:11:09,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 05:11:09,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 05:11:09,793 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:09,793 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:09,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 05:11:09,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:09,794 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:09,794 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:09,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 05:11:09,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:09,794 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:09,794 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:09,794 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:09,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:09,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 05:11:09,794 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:09,795 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:09,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:11:09,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:09,795 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => aa977fc80ff408457e9257d2ab7afdf2, NAME => 'test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 05:11:09,796 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AuthenticationService 2018-05-02 05:11:09,796 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:09,796 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=SecureBulkLoadService 2018-05-02 05:11:09,797 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:09,797 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 05:11:09,798 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:09,798 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:09,798 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:09,799 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AccessControlService 2018-05-02 05:11:09,799 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:09,799 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:09,799 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:09,799 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:09,799 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:11:09,799 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 05:11:09,799 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:09,799 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:09,800 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:09,800 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:09,801 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => 9c38689b653a37956f2ae7364b126f1b, NAME => 'test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 05:11:09,801 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AuthenticationService 2018-05-02 05:11:09,802 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:09,802 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=SecureBulkLoadService 2018-05-02 05:11:09,802 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:09,802 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:09,802 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:09,802 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AccessControlService 2018-05-02 05:11:09,803 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:09,803 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:09,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 9c38689b653a37956f2ae7364b126f1b 2018-05-02 05:11:09,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:09,804 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:09,812 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => 78e8a528d65332a4f7661e8ab427a827, NAME => 'test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:11:09,813 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AuthenticationService 2018-05-02 05:11:09,813 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:09,813 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=SecureBulkLoadService 2018-05-02 05:11:09,813 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:09,813 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:09,813 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:09,814 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AccessControlService 2018-05-02 05:11:09,814 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:09,814 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:09,814 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:11:09,814 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:09,815 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:09,839 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:11:09,840 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:11:09,840 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 05:11:09,840 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 05:11:09,841 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:09,842 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:09,843 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:11:09,843 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:11:09,843 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 05:11:09,843 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 05:11:09,844 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:09,847 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:09,847 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:09,848 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:09,849 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:11:09,849 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:11:09,850 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:09,850 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:09,851 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:09,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:11:09,852 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:09,853 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:09,853 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:09,855 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:09,856 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:09,858 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 05:11:09,862 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b 2018-05-02 05:11:09,863 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:09,864 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:11:09,868 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:11:09,886 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:11:09,889 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:11:09,889 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:09,903 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 107 from saslServer. 2018-05-02 05:11:09,905 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:09,905 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:11:09,906 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:09,906 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:11:09,907 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:11:09,934 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 13 service: ClientService methodName: Scan size: 213 connection: 172.27.61.83:44680 deadline: 1525237929933, exception=org.apache.hadoop.hbase.NotServingRegionException: hbase:meta,,1 is not online on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:09,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:09,935 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=2 2018-05-02 05:11:09,946 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:09,946 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened 78e8a528d65332a4f7661e8ab427a827; next sequenceid=2 2018-05-02 05:11:09,947 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:09,947 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened 9c38689b653a37956f2ae7364b126f1b; next sequenceid=2 2018-05-02 05:11:09,948 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:09,949 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:09,949 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened aa977fc80ff408457e9257d2ab7afdf2; next sequenceid=2 2018-05-02 05:11:09,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:11:09,951 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=2 2018-05-02 05:11:09,952 INFO [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:09,952 INFO [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:09,953 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:09,953 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:09,956 INFO [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:09,957 DEBUG [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:09,957 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:09,958 DEBUG [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:09,959 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:09,960 DEBUG [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:09,961 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:09,961 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:09,967 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:09,967 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:10,547 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:11:13,255 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827." 2018-05-02 05:11:13,255 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 78e8a528d65332a4f7661e8ab427a827 without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,258 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,259 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 78e8a528d65332a4f7661e8ab427a827, disabling compactions & flushes 2018-05-02 05:11:13,259 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:13,263 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5." 2018-05-02 05:11:13,263 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close ffde9f4a59ab08d4830f3b671f736ad5 without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,265 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237." 2018-05-02 05:11:13,265 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close f3db9f9879ed03f488dcb89bea834237 without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,265 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,265 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing ffde9f4a59ab08d4830f3b671f736ad5, disabling compactions & flushes 2018-05-02 05:11:13,265 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:13,266 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2." 2018-05-02 05:11:13,266 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close aa977fc80ff408457e9257d2ab7afdf2 without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,266 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,266 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 05:11:13,266 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:13,266 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b." 2018-05-02 05:11:13,266 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 9c38689b653a37956f2ae7364b126f1b without moving. Requested from /172.27.59.154 2018-05-02 05:11:13,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,310 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,312 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,313 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,313 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,314 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,314 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,314 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,315 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,315 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,315 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,315 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:13,315 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:13,315 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:13,321 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:13,321 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,322 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing aa977fc80ff408457e9257d2ab7afdf2, disabling compactions & flushes 2018-05-02 05:11:13,322 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:13,323 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:13,323 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:13,323 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 9c38689b653a37956f2ae7364b126f1b, disabling compactions & flushes 2018-05-02 05:11:13,324 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:13,339 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:13,357 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,358 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:11:13,364 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,364 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,364 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,365 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:13,365 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:11:13,365 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:11:13,365 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:11:13,365 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:13,370 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:13,370 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:14,685 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:21.191 minutes, events=1, succcessCount=1, totalEvents=1, totalSuccessCount=1 2018-05-02 05:11:14,707 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:14,728 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:14,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 05:11:14,729 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:14,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 05:11:14,729 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => 9c38689b653a37956f2ae7364b126f1b, NAME => 'test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 05:11:14,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 05:11:14,729 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,729 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,729 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,729 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:14,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AuthenticationService 2018-05-02 05:11:14,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 05:11:14,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 05:11:14,729 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=SecureBulkLoadService 2018-05-02 05:11:14,730 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,730 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,730 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 05:11:14,730 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,730 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,730 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,730 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 05:11:14,730 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,730 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,730 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,730 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 05:11:14,730 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:11:14,730 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:14,730 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,730 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AccessControlService 2018-05-02 05:11:14,731 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,731 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,731 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,731 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,731 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:11:14,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 9c38689b653a37956f2ae7364b126f1b 2018-05-02 05:11:14,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:14,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:14,731 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,732 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,737 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:14,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => 78e8a528d65332a4f7661e8ab427a827, NAME => 'test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:11:14,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => aa977fc80ff408457e9257d2ab7afdf2, NAME => 'test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 05:11:14,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AuthenticationService 2018-05-02 05:11:14,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AuthenticationService 2018-05-02 05:11:14,738 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=SecureBulkLoadService 2018-05-02 05:11:14,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,739 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AccessControlService 2018-05-02 05:11:14,738 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:11:14,739 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=SecureBulkLoadService 2018-05-02 05:11:14,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:11:14,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:11:14,739 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,739 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:11:14,739 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:11:14,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:14,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AccessControlService 2018-05-02 05:11:14,740 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:11:14,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:11:14,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 05:11:14,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:14,742 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,742 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:11:14,775 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:11:14,775 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:11:14,777 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,778 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,780 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:11:14,780 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:11:14,782 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,783 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 05:11:14,783 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 05:11:14,783 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,784 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,785 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,785 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,790 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,792 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 05:11:14,792 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 05:11:14,792 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,793 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,794 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,795 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:11:14,797 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:11:14,797 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:11:14,797 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:11:14,798 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:11:14,799 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:11:14,804 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:11:14,814 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,823 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:11:14,824 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:11:14,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:11:14,830 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b 2018-05-02 05:11:14,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 05:11:14,847 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:11:14,890 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,899 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,913 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened 9c38689b653a37956f2ae7364b126f1b; next sequenceid=5 2018-05-02 05:11:14,913 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=5 2018-05-02 05:11:14,916 INFO [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:14,919 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:14,923 DEBUG [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:11:14,923 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:14,923 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:11:14,923 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:14,928 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=5 2018-05-02 05:11:14,929 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,932 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:14,939 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:11:14,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:14,974 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:11:14,985 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened aa977fc80ff408457e9257d2ab7afdf2; next sequenceid=5 2018-05-02 05:11:14,991 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened 78e8a528d65332a4f7661e8ab427a827; next sequenceid=5 2018-05-02 05:11:14,996 INFO [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:14,996 INFO [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:15,004 DEBUG [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:11:15,004 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:15,004 DEBUG [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:11:15,004 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:11:15,309 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:11:15,634 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:11:15,639 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:11:15,793 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:11:15,794 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:11:15,794 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:11:15,803 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:11:15,806 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:11:15,806 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:11:15,850 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:11:15,852 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:11:15,852 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:15,855 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:11:15,858 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:15,858 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:11:15,860 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:15,860 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:11:15,861 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:11:16,317 DEBUG [RS-EventLoopGroup-1-7] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:11:16,325 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:11:16,326 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:16,334 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:11:16,338 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:16,339 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:11:16,354 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:11:16,361 DEBUG [RS-EventLoopGroup-1-7] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:11:16,362 DEBUG [RS-EventLoopGroup-1-7] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:11:19,738 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:11:19,749 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:11:19,760 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:11:20,268 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:11:21,145 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:11:21,145 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:11:21,397 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 151 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:21,547 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:11:21,548 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:11:21,548 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:11:21,604 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:11:21,621 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:11:21,621 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:11:22,938 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 166 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:22,939 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 166 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:22,941 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 170 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:25,791 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 197 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:27,878 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 214 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:27,883 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 216 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:30,831 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 380 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:30,831 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 379 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:30,832 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 383 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:30,837 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 382 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:33,852 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 135 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:33,853 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 137 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:33,853 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 137 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:33,853 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 139 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:33,854 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 139 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:36,410 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 147 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:38,249 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 159 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:39,892 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 182 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:39,892 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 182 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:39,893 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 183 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:39,895 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 182 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:39,895 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 183 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:41,226 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 247 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:41,227 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 248 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:41,229 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 255 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:41,230 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 247 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:41,230 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 248 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:42,570 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 218 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:44,362 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 236 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:47,869 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 168 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:47,869 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 170 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:47,870 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 170 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:47,872 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 172 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:47,872 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 173 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:49,588 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 169 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:51,200 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 200 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:51,200 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 201 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:51,200 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 201 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:51,200 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 200 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:51,200 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 200 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:53,719 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.040 minutes, events=396, succcessCount=194, totalEvents=398, totalSuccessCount=195 2018-05-02 05:11:55,844 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 111 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:56,941 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 109 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:56,942 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 110 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:56,942 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 111 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:56,942 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 112 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:11:56,943 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 112 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:00,244 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 214 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:01,490 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 174 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:01,494 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 178 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:01,494 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 182 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:01,494 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 183 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:03,661 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 115 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:09,318 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3737) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:12:14,783 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.097 minutes, events=263, succcessCount=263, totalEvents=264, totalSuccessCount=264 2018-05-02 05:12:15,981 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 131 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:15,981 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 133 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:15,982 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 134 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:15,982 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 134 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:15,983 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 132 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:16,832 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 166 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:16,832 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 166 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:16,832 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 166 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:29,557 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 225 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:29,557 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 224 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:29,559 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 225 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:30,841 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 249 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:32,054 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 330 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:32,054 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 332 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:32,054 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 331 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:32,054 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 330 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:32,055 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 331 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:33,393 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 206 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:33,394 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 206 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:33,394 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 206 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:33,400 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 210 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:34,467 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 166 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:35,807 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 153 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:35,807 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 154 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:35,807 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 154 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:37,142 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 185 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:38,742 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 157 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:38,743 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 158 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:38,743 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 157 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:38,748 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 162 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:40,467 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 129 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:40,467 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 130 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:42,387 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 171 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:42,388 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 171 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:47,425 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 144 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:47,426 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 145 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:47,426 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 144 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:47,426 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 145 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:47,429 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 147 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:48,952 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 169 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:48,954 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 170 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:50,287 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 147 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:50,295 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 154 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:12:53,739 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.020 minutes, events=565, succcessCount=253, totalEvents=963, totalSuccessCount=448 2018-05-02 05:13:08,891 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 175 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:13:08,891 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 176 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:13:08,894 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 177 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:13:08,895 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 177 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:13:08,895 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 178 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 05:13:14,878 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.096 minutes, events=276, succcessCount=276, totalEvents=540, totalSuccessCount=540 2018-05-02 05:13:53,879 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.141 minutes, events=274, succcessCount=138, totalEvents=1237, totalSuccessCount=586 2018-05-02 05:14:10,017 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 05:14:10,019 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 1 failover attempts. Trying to failover after sleeping for 1456ms. 2018-05-02 05:14:11,477 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 2 failover attempts. Trying to failover after sleeping for 2585ms. 2018-05-02 05:14:14,064 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 3 failover attempts. Trying to failover after sleeping for 4678ms. 2018-05-02 05:14:18,745 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 4 failover attempts. Trying to failover after sleeping for 9046ms. 2018-05-02 05:14:27,794 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 5 failover attempts. Trying to failover after sleeping for 22211ms. 2018-05-02 05:14:44,626 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=155.91 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=2, accesses=5, hits=3, hitRatio=60.00%, , cachingAccesses=5, cachingHits=3, cachingHitsRatio=60.00%, evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:14:50,008 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 6 failover attempts. Trying to failover after sleeping for 12156ms. 2018-05-02 05:15:02,186 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3737) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 7 failover attempts. Trying to failover after sleeping for 12952ms. 2018-05-02 05:15:05,124 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=6, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:15:05,125 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:15:15,001 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:15:15,004 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:15:15,005 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:15:15,164 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category WRITE is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3737) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Trying to failover after sleeping for 17006ms. 2018-05-02 05:15:15,515 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:15:15,984 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:15:15,984 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:15:16,144 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:15:16,144 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:15:16,144 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:15:16,161 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:15:16,166 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:15:16,166 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:15:32,202 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1680125465_1. Name node is in safe mode. The reported blocks 201 needs additional 35 blocks to reach the threshold 1.0000 of total blocks 236. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1680125465_1. Name node is in safe mode. The reported blocks 201 needs additional 35 blocks to reach the threshold 1.0000 of total blocks 236. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 11881ms. Wed May 2 05:17:38 UTC 2018 Terminating regionserver 2018-05-02 05:17:38,554 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 05:17:38,554 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 05:17:38,554 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 05:17:38,557 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 05:17:38,557 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 05:17:38,557 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 05:17:38,557 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 05:17:38,557 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:17:38,557 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 3 milli seconds 2018-05-02 05:17:38,557 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 05:17:38,557 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 05:17:38,557 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:17:38,558 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:17:38,558 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 05:17:38,558 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 05:17:38,558 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 05:17:38,558 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223' ***** 2018-05-02 05:17:38,558 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 05:17:38,558 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 05:17:38,559 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 05:17:38,559 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:17:38,559 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 05:17:38,559 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 05:17:38,559 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,559 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 05:17:38,559 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:17:38,559 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 05:17:38,560 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:17:38,560 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 05:17:38,560 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 05:17:38,560 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=04:23.682 minutes, events=46, succcessCount=46, totalEvents=586, totalSuccessCount=586 2018-05-02 05:17:38,560 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:17:38,560 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 05:17:38,560 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:17:38,574 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:17:38,575 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 05:17:38,575 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 05:17:38,575 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 05:17:38,577 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 05:17:38,577 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 exiting 2018-05-02 05:17:38,596 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@71e4b308{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:17:38,605 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] server.AbstractConnector: Stopped ServerConnector@51ec2856{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:17:38,605 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 05:17:38,605 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@26cb5207{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 05:17:38,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 05:17:38,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 05:17:38,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 05:17:38,608 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 05:17:38,608 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 05:17:38,609 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,610 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,610 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,610 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 05:17:38,611 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:17:38,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing aa977fc80ff408457e9257d2ab7afdf2, disabling compactions & flushes 2018-05-02 05:17:38,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:17:38,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,611 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 8dc6fd2022c2fdf8c065fbd16cadaaca, disabling compactions & flushes 2018-05-02 05:17:38,611 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,611 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:17:38,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:38,612 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:17:38,612 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 05:17:38,613 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x12c8ef07 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:17:38,613 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:17:38,613 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 7 regions to close 2018-05-02 05:17:38,613 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Online Regions={f3db9f9879ed03f488dcb89bea834237=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237., aa977fc80ff408457e9257d2ab7afdf2=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2., 8dc6fd2022c2fdf8c065fbd16cadaaca=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca., ffde9f4a59ab08d4830f3b671f736ad5=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5., 9c38689b653a37956f2ae7364b126f1b=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b., 78e8a528d65332a4f7661e8ab427a827=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827., 60955ebb25dcf0aeb6d46e894a921538=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.} 2018-05-02 05:17:38,613 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.89 MB memstore heap size=2.83 MB 2018-05-02 05:17:38,613 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=10.56 KB memstore heap size=11.90 KB 2018-05-02 05:17:38,613 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.96 MB memstore heap size=2.94 MB 2018-05-02 05:17:38,752 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 05:17:38,891 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=10.56 KB at sequenceid=26 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/.tmp/dt/a09cc6d66c9d40afb5210ff9303caf73 2018-05-02 05:17:39,047 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/.tmp/dt/a09cc6d66c9d40afb5210ff9303caf73 as hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/a09cc6d66c9d40afb5210ff9303caf73 2018-05-02 05:17:39,109 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.89 MB at sequenceid=12052 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/.tmp/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 05:17:39,118 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/a09cc6d66c9d40afb5210ff9303caf73, entries=18, sequenceid=26, filesize=6.0 K 2018-05-02 05:17:39,151 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Finished memstore flush; data size ~10.56 KB/10816, heap size ~12.11 KB/12400, currentsize=0 B/0 for 8dc6fd2022c2fdf8c065fbd16cadaaca in 538ms, sequenceid=26, compaction requested=false 2018-05-02 05:17:39,161 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/.tmp/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 05:17:39,167 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.96 MB at sequenceid=12512 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/.tmp/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 2018-05-02 05:17:39,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/29.seqid, newMaxSeqId=29, maxSeqId=21 2018-05-02 05:17:39,228 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f, entries=13088, sequenceid=12052, filesize=2.0 M 2018-05-02 05:17:39,236 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:17:39,236 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:17:39,236 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:17:39,236 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:17:39,237 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 05:17:39,237 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:39,238 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Finished memstore flush; data size ~1.89 MB/1978128, heap size ~2.83 MB/2970024, currentsize=0 B/0 for f3db9f9879ed03f488dcb89bea834237 in 625ms, sequenceid=12052, compaction requested=false 2018-05-02 05:17:39,238 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/.tmp/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 2018-05-02 05:17:39,244 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing ffde9f4a59ab08d4830f3b671f736ad5, disabling compactions & flushes 2018-05-02 05:17:39,244 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:17:39,245 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.87 MB memstore heap size=2.81 MB 2018-05-02 05:17:39,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12055.seqid, newMaxSeqId=12055, maxSeqId=5 2018-05-02 05:17:39,309 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf/2824b9271dd345d7b1f1d94e7ff12b82, entries=13578, sequenceid=12512, filesize=2.0 M 2018-05-02 05:17:39,311 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Finished memstore flush; data size ~1.96 MB/2055917, heap size ~2.94 MB/3084624, currentsize=0 B/0 for aa977fc80ff408457e9257d2ab7afdf2 in 697ms, sequenceid=12512, compaction requested=false 2018-05-02 05:17:39,312 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:17:39,312 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:17:39,312 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:17:39,313 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:17:39,313 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:17:39,313 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:39,313 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 9c38689b653a37956f2ae7364b126f1b, disabling compactions & flushes 2018-05-02 05:17:39,314 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:17:39,314 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.99 MB memstore heap size=2.99 MB 2018-05-02 05:17:39,369 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12515.seqid, newMaxSeqId=12515, maxSeqId=5 2018-05-02 05:17:39,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:17:39,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:17:39,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:17:39,401 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:17:39,401 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 05:17:39,401 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:39,402 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 78e8a528d65332a4f7661e8ab427a827, disabling compactions & flushes 2018-05-02 05:17:39,402 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:17:39,402 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.00 MB memstore heap size=3.00 MB 2018-05-02 05:17:39,407 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.87 MB at sequenceid=11973 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/.tmp/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 05:17:39,445 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.99 MB at sequenceid=12727 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/.tmp/test_cf/e5a8c5ffbf754c8796432534239a0e81 2018-05-02 05:17:39,449 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/.tmp/test_cf/ad05533bf01540c0b9bab2e9f27770e0 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 05:17:39,504 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/.tmp/test_cf/e5a8c5ffbf754c8796432534239a0e81 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf/e5a8c5ffbf754c8796432534239a0e81 2018-05-02 05:17:39,526 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0, entries=13000, sequenceid=11973, filesize=2.0 M 2018-05-02 05:17:39,528 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Finished memstore flush; data size ~1.87 MB/1965560, heap size ~2.81 MB/2950848, currentsize=0 B/0 for ffde9f4a59ab08d4830f3b671f736ad5 in 284ms, sequenceid=11973, compaction requested=false 2018-05-02 05:17:39,540 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.00 MB at sequenceid=12772 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/.tmp/test_cf/8fa92c4235cd4abea8812b60b038dcf2 2018-05-02 05:17:39,580 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf/e5a8c5ffbf754c8796432534239a0e81, entries=13818, sequenceid=12727, filesize=2.1 M 2018-05-02 05:17:39,581 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11976.seqid, newMaxSeqId=11976, maxSeqId=5 2018-05-02 05:17:39,583 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Finished memstore flush; data size ~1.99 MB/2089655, heap size ~2.99 MB/3136664, currentsize=0 B/0 for 9c38689b653a37956f2ae7364b126f1b in 268ms, sequenceid=12727, compaction requested=false 2018-05-02 05:17:39,607 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/.tmp/test_cf/8fa92c4235cd4abea8812b60b038dcf2 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf/8fa92c4235cd4abea8812b60b038dcf2 2018-05-02 05:17:39,614 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 4 regions to close 2018-05-02 05:17:39,614 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Online Regions={ffde9f4a59ab08d4830f3b671f736ad5=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5., 9c38689b653a37956f2ae7364b126f1b=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b., 78e8a528d65332a4f7661e8ab427a827=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827., 60955ebb25dcf0aeb6d46e894a921538=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.} 2018-05-02 05:17:39,620 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:17:39,620 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:17:39,620 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:17:39,620 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:17:39,621 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:17:39,621 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:17:39,621 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 60955ebb25dcf0aeb6d46e894a921538, disabling compactions & flushes 2018-05-02 05:17:39,621 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:17:39,661 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12730.seqid, newMaxSeqId=12730, maxSeqId=5 2018-05-02 05:17:39,665 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf/8fa92c4235cd4abea8812b60b038dcf2, entries=13861, sequenceid=12772, filesize=2.1 M 2018-05-02 05:17:39,667 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Finished memstore flush; data size ~2.00 MB/2096362, heap size ~3.00 MB/3146592, currentsize=0 B/0 for 78e8a528d65332a4f7661e8ab427a827 in 265ms, sequenceid=12772, compaction requested=false 2018-05-02 05:17:39,674 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=10 2018-05-02 05:17:39,682 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:17:39,683 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:17:39,683 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:17:39,683 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:17:39,683 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:17:39,692 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:17:39,692 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:17:39,693 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:17:39,693 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:17:39,693 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 05:17:39,714 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12775.seqid, newMaxSeqId=12775, maxSeqId=5 2018-05-02 05:17:39,728 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:17:39,728 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:17:39,728 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:17:39,728 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:17:39,728 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:17:39,814 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223; all regions closed. 2018-05-02 05:17:39,815 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:17:39,852 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 05:17:39,852 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525237777223:(num 1525237808387) 2018-05-02 05:17:39,852 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:17:39,855 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Leases: Closed leases 2018-05-02 05:17:39,856 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 had [[ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 05:17:39,857 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 05:17:39,857 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 05:17:39,857 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 05:17:39,857 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 05:17:39,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.NettyRpcServer: Stopping server on /172.27.70.95:16020 2018-05-02 05:17:39,864 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 05:17:39,864 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 05:17:39,905 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390065, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223 2018-05-02 05:17:39,905 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d9390065, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:17:39,907 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:17:39,907 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ZooKeeper: Session: 0x2631f08d9390065 closed 2018-05-02 05:17:39,907 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525237777223; zookeeper connection closed. 2018-05-02 05:17:39,908 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 05:17:39,909 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 05:18:03 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000002.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1031588 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 05:18:06,459 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 05:18:06,462 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 05:18:06,463 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 05:18:06,463 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 05:18:06,463 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 05:18:07,279 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 05:18:07,280 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 05:18:07,280 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 05:18:07,280 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:18:07,282 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 05:18:07,283 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 05:18:07,283 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 05:18:07,283 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:18:07,283 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 05:18:07,283 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 05:18:07,283 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 05:18:07,283 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:18:07,283 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 05:18:07,283 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 05:18:07,285 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 05:18:07,285 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 05:18:07,286 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 05:18:07,286 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 05:18:07,286 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 05:18:07,287 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 05:18:07,287 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 05:18:07,287 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 05:18:07,287 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:18:07,287 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 05:18:07,287 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 05:18:07,287 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 05:18:07,287 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 05:18:07,288 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020518 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 05:18:07,288 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 05:18:07,288 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 05:18:07,288 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 05:18:07,288 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log 2018-05-02 05:18:07,288 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 05:18:07,288 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 05:18:07,288 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 05:18:07,288 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 05:18:07,290 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=409596 2018-05-02 05:18:07,290 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:18:07,291 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 05:18:07,291 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 05:18:07,291 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 05:18:07,291 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 05:18:07,291 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:18:07,291 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 05:18:07,291 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 05:18:07,292 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:18:07,299 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020518 2018-05-02 05:18:07,312 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 05:18:07,312 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 05:18:07,312 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:18:07,312 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 05:18:07,312 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 05:18:07,312 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 05:18:07,312 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 05:18:07,313 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 05:18:07,313 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 05:18:07,316 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 05:18:07,317 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020518, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 05:18:07,696 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:18:08,450 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 05:18:08,592 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:18:09,757 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:18:09,764 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:18:10,525 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:18:10,525 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:18:10,525 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:18:10,765 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:18:11,183 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:18:11,183 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:18:11,233 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 05:18:11,917 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 server-side Connection retries=105 2018-05-02 05:18:11,944 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:18:11,948 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 05:18:11,948 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 05:18:11,949 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 05:18:11,949 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:18:11,950 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:18:12,268 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 05:18:12,622 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 05:18:12,649 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 05:18:12,820 INFO [main] ipc.NettyRpcServer: Bind to /172.27.70.95:16020 2018-05-02 05:18:13,287 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 05:18:13,292 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:18:13,295 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 05:18:13,334 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:18:13,337 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:18:13,358 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 05:18:15,808 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:18:15,830 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:18:15,999 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:18:16,017 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 05:18:16,017 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:18:16,018 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 05:18:16,018 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 05:18:16,018 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 05:18:16,018 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 05:18:16,019 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:18:16,019 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 05:18:16,019 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 05:18:16,019 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 05:18:16,019 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 05:18:16,019 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=4.15.12-1.el7.elrepo.x86_64 2018-05-02 05:18:16,019 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 05:18:16,020 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 05:18:16,020 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 05:18:16,022 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 05:18:16,102 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 05:18:16,105 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 05:18:16,116 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:18:16,149 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:18:16,165 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 05:18:16,175 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 05:18:16 UTC 2018 2018-05-02 05:18:16,182 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 05:18:16 UTC 2018 2018-05-02 05:18:16,182 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:31:08 UTC 2018 2018-05-02 05:18:16,184 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b279006c, negotiated timeout = 90000 2018-05-02 05:18:16,196 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 05:18:16,197 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c connected 2018-05-02 05:18:16,275 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 05:18:16,426 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:18:16,426 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:18:16,436 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:18:16,551 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 05:18:16,581 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 05:18:16,593 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 05:18:16,662 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 05:18:16,701 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 05:18:16,786 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 05:18:16,786 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 05:18:16,786 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 05:18:17,035 INFO [main] util.log: Logging initialized @12154ms 2018-05-02 05:18:17,179 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 05:18:17,209 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 05:18:17,210 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 05:18:17,214 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 05:18:17,215 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 05:18:17,215 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 05:18:17,285 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 05:18:17,287 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 05:18:17,383 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 05:18:17,384 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 05:18:17,729 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:18:17,738 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000002.hwx.site,h=[ctr-e138-1518143905142-279227-01-000002.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 05:18:17,762 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:18:17,762 INFO [main] server.Server: Started @12881ms 2018-05-02 05:18:17,836 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 05:18:17,851 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 05:18:17,889 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 05:18:17,889 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 05:18:17,895 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 05:18:17,943 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Connect 0x4c062352 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 05:18:17,962 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x4c062352] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/1200490405@28c8130 2018-05-02 05:18:17,963 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x4c062352-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:18:17,965 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x4c062352-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:18:17,966 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x4c062352-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:18:17,970 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x4c062352-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d9390072, negotiated timeout = 90000 2018-05-02 05:18:18,041 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79659458, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 05:18:18,044 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b75a355, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:0 2018-05-02 05:18:18,055 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000002:16020 2018-05-02 05:18:18,079 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 05:18:18,080 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 05:18:18,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 05:18:18,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 05:18:18,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:18:18,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 05:18:18,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:18:18,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 05:18:18,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:18:18,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 05:18:18,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 05:18:18,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 05:18:18,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:18:18,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 05:18:18,459 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 05:18:18,466 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 05:18:18,472 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 05:18:18,472 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 05:18:18,478 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 05:18:18,479 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:18:18,567 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 05:18:18,568 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 05:18:18,651 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 05:18:18,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: init() called 2018-05-02 05:18:18,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:18:18,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 05:18:18,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 05:18:18,652 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 05:18:18,653 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 05:18:18,654 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:18:18,654 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 05:18:18,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:18:18,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 05:18:18,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 05:18:18,678 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:18:18,834 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 05:18:18,906 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 05:18:18,906 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 05:18:18,909 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:18:18,909 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:18:18,909 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 05:18:18,909 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 05:18:18,910 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 05:18:18,918 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 05:18:18,918 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 05:18:18,918 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 05:18:18,919 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 05:18:18,919 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 05:18:18,920 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 05:18:18,921 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 05:18:18,921 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 05:18:18,921 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 05:18:18,921 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 05:18:18,921 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 05:18:18,922 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 05:18:18,922 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 05:18:18,923 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:18:18,924 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:18:18,924 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 05:18:18,924 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 05:18:18,924 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 05:18:18,925 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 05:18:18,926 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:18:18,926 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:18:18,926 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 05:18:18,926 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 05:18:18,927 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 05:18:18,927 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 05:18:18,927 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 05:18:18,931 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:18:18,941 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:18:18,942 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 05:18:19,251 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:18:19,756 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:18:21,224 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:18:21,225 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 05:18:22,533 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 05:18:22,723 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:18:22,724 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:18:22,725 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:18:22,727 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 05:18:22,727 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 05:18:22,757 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525237764081 with port=16020, startcode=1525238287427 2018-05-02 05:18:23,026 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:18:23,026 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:18:23,045 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:18:23,237 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:18:23,260 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:18:23,311 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:18:23,322 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:18:23,327 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:18:23,328 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:18:23,329 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:18:23,443 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 05:18:23,443 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 05:18:23,443 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 05:18:23,522 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:18:23,547 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:18:23,898 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 05:18:23,928 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 05:18:23,998 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 05:18:24,019 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 05:18:24,038 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 05:18:24,084 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 05:18:24,622 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:18:24,623 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:18:24,623 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:18:24,623 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:18:24,623 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:18:24,623 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 05:18:24,624 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 05:18:24,628 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:18:24,713 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 starting 2018-05-02 05:18:24,715 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:18:24,726 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 05:18:24,736 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:18:24,751 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 05:18:24,761 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 05:18:24,812 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237780568, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427] other RSs: [ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237780568, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427] 2018-05-02 05:18:24,904 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427, RpcServer on ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:16020, sessionid=0x3631f08b279006c 2018-05-02 05:18:24,904 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 05:18:24,904 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:18:24,904 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427' 2018-05-02 05:18:24,904 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 05:18:24,907 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 05:18:24,914 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 05:18:24,914 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 05:18:24,915 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:18:24,915 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427' 2018-05-02 05:18:24,915 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 05:18:24,918 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 05:18:24,919 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 05:18:24,919 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 05:18:24,919 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 05:18:28,066 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525238287427, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:18:28,838 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Slow sync cost: 646 ms, current pipeline: [] 2018-05-02 05:18:28,841 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525238287427.1525238308066 2018-05-02 05:18:28,841 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:19:17,996 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x4c062352] zookeeper.ZooKeeper: Session: 0x2631f08d9390072 closed 2018-05-02 05:19:17,996 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x4c062352-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:19:18,535 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237780568 2018-05-02 05:19:18,540 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525237780568 znode expired, triggering replicatorRemoved event 2018-05-02 05:19:18,543 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:19:19,065 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:19:19,072 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:19:19,072 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:19,081 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:19:19,095 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:19,096 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:19:19,097 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:19,098 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:19:19,099 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:19:19,266 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 05:19:19,394 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:19:19,449 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 5080f353428ccd74e13d5b5493533655, NAME => 'atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655.', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:19:19,449 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => 4c37ee7a4e1210e481debdc2933fc4d2, NAME => 'test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 05:19:19,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=AuthenticationService 2018-05-02 05:19:19,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=AuthenticationService 2018-05-02 05:19:19,518 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:19:19,518 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:19:19,523 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=SecureBulkLoadService 2018-05-02 05:19:19,523 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=SecureBulkLoadService 2018-05-02 05:19:19,524 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:19:19,524 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:19:19,524 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:19:19,524 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=AccessControlService 2018-05-02 05:19:19,530 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:19:19,530 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:19:19,531 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:19:19,531 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. service=AccessControlService 2018-05-02 05:19:19,531 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:19:19,531 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:19:19,533 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:19:19,533 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:19:19,575 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 4c37ee7a4e1210e481debdc2933fc4d2 2018-05-02 05:19:19,575 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table atlas_janus 5080f353428ccd74e13d5b5493533655 2018-05-02 05:19:19,575 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:19:19,575 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 05:19:19,605 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:19:19,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2018-05-02 05:19:19,623 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 05:19:19,625 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:19:19,738 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf 2018-05-02 05:19:19,738 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf 2018-05-02 05:19:19,738 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e 2018-05-02 05:19:19,739 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e 2018-05-02 05:19:19,792 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:19,799 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for e: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:19,813 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:19,821 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:19,992 INFO [StoreFileOpenerThread-e-1] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 05:19:20,014 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/0dcbaa416cd04a0daf2e0ffa616f4483 2018-05-02 05:19:20,014 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf/719182bd2f5b43a9b5002dd5ebd23549 2018-05-02 05:19:20,019 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:20,053 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/0e04b7f50c33486183892dcc025b3b9e 2018-05-02 05:19:20,053 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=e, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:20,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2 2018-05-02 05:19:20,066 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f 2018-05-02 05:19:20,066 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f 2018-05-02 05:19:20,068 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for f: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:20,070 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:20,162 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/f/44685d33ae944737b0ce1882809b4eb3 2018-05-02 05:19:20,162 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=f, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:20,178 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g 2018-05-02 05:19:20,178 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g 2018-05-02 05:19:20,180 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for g: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:20,181 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:20,194 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/recovered.edits/12221.seqid, newMaxSeqId=12221, maxSeqId=12220 2018-05-02 05:19:20,205 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 4c37ee7a4e1210e481debdc2933fc4d2; next sequenceid=12221 2018-05-02 05:19:20,233 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/5eed4e40427048bd8d7677364442015e 2018-05-02 05:19:20,264 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/e657add726e444899ef9d52245c1bd4c 2018-05-02 05:19:20,264 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=g, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:20,276 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h 2018-05-02 05:19:20,276 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h 2018-05-02 05:19:20,278 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for h: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:20,279 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:20,363 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/h/533a2948760c480ba34565e6621f062e 2018-05-02 05:19:20,364 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=h, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:20,395 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i 2018-05-02 05:19:20,395 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i 2018-05-02 05:19:20,396 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for i: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:20,397 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:20,408 INFO [PostOpenDeployTasks:4c37ee7a4e1210e481debdc2933fc4d2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:19:20,478 DEBUG [PostOpenDeployTasks:4c37ee7a4e1210e481debdc2933fc4d2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:19:20,480 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:19:20,507 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/i/85d84799b3024ff6a31c00aeddf0ee17 2018-05-02 05:19:20,507 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=i, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:20,525 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/l 2018-05-02 05:19:20,525 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/l 2018-05-02 05:19:20,526 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:20,527 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:20,533 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:20,545 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m 2018-05-02 05:19:20,545 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m 2018-05-02 05:19:20,547 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for m: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:20,548 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:20,614 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/m/86b207dade28462496c6e41eb3fb7b1f 2018-05-02 05:19:20,614 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=m, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:20,627 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s 2018-05-02 05:19:20,628 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s 2018-05-02 05:19:20,629 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for s: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:20,630 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:20,702 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s/ab9566a0b14843359aac2c9357d7f66b 2018-05-02 05:19:20,760 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/s/e6968dada3bb41138eae59b19cb69762 2018-05-02 05:19:20,760 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=s, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:20,773 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/t 2018-05-02 05:19:20,773 DEBUG [StoreOpener-5080f353428ccd74e13d5b5493533655-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/t 2018-05-02 05:19:20,775 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] hfile.CacheConfig: Created cacheConfig for t: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:19:20,776 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:19:20,781 INFO [StoreOpener-5080f353428ccd74e13d5b5493533655-1] regionserver.HStore: Store=t, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:19:20,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655 2018-05-02 05:19:20,817 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table atlas_janus descriptor;using region.getMemStoreFlushHeapSize/# of families (16.0M)) instead. 2018-05-02 05:19:20,850 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/recovered.edits/1585.seqid, newMaxSeqId=1585, maxSeqId=1584 2018-05-02 05:19:20,859 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 5080f353428ccd74e13d5b5493533655; next sequenceid=1585 2018-05-02 05:19:20,877 INFO [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.HRegionServer: Post open deploy tasks for atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 05:19:20,882 DEBUG [PostOpenDeployTasks:5080f353428ccd74e13d5b5493533655] regionserver.HRegionServer: Finished post open deploy task for atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 05:19:20,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:19:21,213 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:19:21,213 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 05:19:21,214 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:19:21,214 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 05:19:21,215 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:19:21,215 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 05:19:21,616 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:19:21,617 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:19:21,617 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:21,621 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:19:21,622 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:21,622 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:19:21,623 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:21,624 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:19:21,624 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:19:21,651 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:19:21,652 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:19:21,652 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:21,655 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:19:21,657 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:21,657 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:19:21,659 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:19:21,659 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:19:21,659 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:19:23,999 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:19:23,999 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:19:24,578 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:19:24,736 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:19:24,751 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:19:24,985 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@5dd43056 2018-05-02 05:19:25,007 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:19:25,009 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:19:25,009 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 05:19:25,013 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00b2, negotiated timeout = 10000 2018-05-02 05:19:25,062 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:19:25,072 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:19:25,263 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:19:25,621 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:19:25,629 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:19:25,736 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:19:25,736 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:19:25,736 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:19:25,745 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:19:25,751 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:19:25,751 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:19:50,868 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:20:11,522 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:20:11,546 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 05:20:11,546 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 05:20:11,547 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:11,547 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 05:20:11,547 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:11,547 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:11,547 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:11,547 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 05:20:11,548 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:11,548 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:11,548 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 05:20:11,548 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:20:11,549 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:11,575 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:20:11,576 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 05:20:11,578 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:11,579 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:11,663 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 05:20:11,663 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:11,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 05:20:11,712 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12533.seqid, newMaxSeqId=12533, maxSeqId=12532 2018-05-02 05:20:11,720 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=12533 2018-05-02 05:20:11,734 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:20:11,739 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:20:11,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:20:12,818 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:20:12,835 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:20:12,836 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 05:20:12,836 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:12,836 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 05:20:12,836 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:12,836 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:12,836 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:12,837 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 05:20:12,837 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:12,837 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:12,837 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:20:12,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:20:12,838 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:12,859 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:20:12,860 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 05:20:12,861 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:12,861 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:12,905 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 05:20:12,905 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:12,924 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 05:20:12,977 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13452.seqid, newMaxSeqId=13452, maxSeqId=13451 2018-05-02 05:20:12,986 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=13452 2018-05-02 05:20:12,996 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:20:13,003 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:20:13,004 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:20:13,618 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:20:13,630 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 05:20:13,630 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 05:20:13,630 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:13,630 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 05:20:13,630 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:13,631 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:13,631 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:13,631 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 05:20:13,631 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:13,631 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:13,631 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:20:13,631 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:20:13,632 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:13,648 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:20:13,648 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:20:13,649 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:13,650 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:13,682 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 05:20:13,682 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:13,691 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:20:13,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12059.seqid, newMaxSeqId=12059, maxSeqId=12058 2018-05-02 05:20:13,735 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=12059 2018-05-02 05:20:13,738 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:20:13,743 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:20:13,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:20:16,027 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:20:16,038 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 05:20:16,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 05:20:16,039 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:16,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 05:20:16,039 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:16,039 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:16,039 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:16,039 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 05:20:16,040 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:16,040 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:16,040 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:20:16,040 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:20:16,040 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:16,055 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:20:16,055 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:20:16,057 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:16,058 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:16,093 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 05:20:16,093 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:16,103 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:20:16,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11980.seqid, newMaxSeqId=11980, maxSeqId=11979 2018-05-02 05:20:16,148 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=11980 2018-05-02 05:20:16,153 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:20:16,158 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:20:16,160 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:20:16,269 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:20:16,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => c078deb2474e9c19b85b5fdb9efaa47d, NAME => 'test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 05:20:16,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AuthenticationService 2018-05-02 05:20:16,283 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:16,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=SecureBulkLoadService 2018-05-02 05:20:16,283 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:16,283 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:16,283 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:16,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AccessControlService 2018-05-02 05:20:16,283 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:16,283 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:16,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 05:20:16,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:20:16,284 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:16,305 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 05:20:16,305 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 05:20:16,306 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:16,307 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:16,358 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf/0c830418052d48119c37552925d65824 2018-05-02 05:20:16,358 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:16,366 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 05:20:16,407 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11344.seqid, newMaxSeqId=11344, maxSeqId=11343 2018-05-02 05:20:16,414 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened c078deb2474e9c19b85b5fdb9efaa47d; next sequenceid=11344 2018-05-02 05:20:16,418 INFO [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:20:16,423 DEBUG [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:20:16,423 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:20:16,549 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:20:16,550 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:20:16,553 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:20:17,059 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:20:17,531 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:20:17,531 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:20:17,613 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:20:17,613 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:20:17,613 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:20:17,619 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:20:17,622 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:20:17,622 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:20:18,954 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=50, succcessCount=25, totalEvents=50, totalSuccessCount=25 2018-05-02 05:20:19,650 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2." 2018-05-02 05:20:19,672 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Close 4c37ee7a4e1210e481debdc2933fc4d2, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245. Requested from /172.27.59.154 2018-05-02 05:20:19,676 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:19,676 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 4c37ee7a4e1210e481debdc2933fc4d2, disabling compactions & flushes 2018-05-02 05:20:19,676 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:20:19,756 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/recovered.edits/12223.seqid, newMaxSeqId=12223, maxSeqId=12221 2018-05-02 05:20:19,763 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:20:19,765 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:20:19,765 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:20:19,767 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:20:19,768 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding 4c37ee7a4e1210e481debdc2933fc4d2 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245 record at close sequenceid=12221 2018-05-02 05:20:19,773 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:20:24,765 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:20:24,769 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:20:24,769 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:20:24,954 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=28, succcessCount=28, totalEvents=28, totalSuccessCount=28 2018-05-02 05:20:25,276 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:20:25,809 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:20:25,813 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:20:25,905 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:20:25,905 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:20:25,905 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:20:25,919 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:20:25,925 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:20:25,925 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:20:45,175 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241 2018-05-02 05:20:45,178 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525237772241 znode expired, triggering replicatorRemoved event 2018-05-02 05:20:45,178 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:20:45,636 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:20:45,686 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:20:45,687 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => 9c38689b653a37956f2ae7364b126f1b, NAME => 'test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 05:20:45,687 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AuthenticationService 2018-05-02 05:20:45,688 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:45,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=SecureBulkLoadService 2018-05-02 05:20:45,688 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:45,688 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:45,688 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:45,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AccessControlService 2018-05-02 05:20:45,688 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:45,688 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:45,688 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => 411bd5dbc3845cf91c0d9f4649c84b86, NAME => 'test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86.', STARTKEY => '5c28f5bb', ENDKEY => '6666665e'} 2018-05-02 05:20:45,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 9c38689b653a37956f2ae7364b126f1b 2018-05-02 05:20:45,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:20:45,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AuthenticationService 2018-05-02 05:20:45,689 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:20:45,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=SecureBulkLoadService 2018-05-02 05:20:45,689 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:20:45,689 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:20:45,689 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:45,689 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:20:45,689 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. service=AccessControlService 2018-05-02 05:20:45,690 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:20:45,690 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:20:45,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 05:20:45,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:20:45,691 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:20:45,712 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 05:20:45,712 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf 2018-05-02 05:20:45,713 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:45,715 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:45,726 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 05:20:45,726 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 05:20:45,728 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:20:45,729 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:20:45,797 DEBUG [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/test_cf/3e55aa0d1ef34928a8504c63d2ce31e2 2018-05-02 05:20:45,797 INFO [StoreOpener-411bd5dbc3845cf91c0d9f4649c84b86-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:45,808 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86 2018-05-02 05:20:45,814 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf/e5a8c5ffbf754c8796432534239a0e81 2018-05-02 05:20:45,815 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:20:45,829 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b 2018-05-02 05:20:45,850 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12580.seqid, newMaxSeqId=12580, maxSeqId=12579 2018-05-02 05:20:45,859 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened 411bd5dbc3845cf91c0d9f4649c84b86; next sequenceid=12580 2018-05-02 05:20:45,866 INFO [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:20:45,876 DEBUG [PostOpenDeployTasks:411bd5dbc3845cf91c0d9f4649c84b86] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:20:45,876 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:20:45,879 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12737.seqid, newMaxSeqId=12737, maxSeqId=12736 2018-05-02 05:20:45,889 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened 9c38689b653a37956f2ae7364b126f1b; next sequenceid=12737 2018-05-02 05:20:45,895 INFO [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:20:45,899 DEBUG [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:20:45,900 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:20:50,689 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:20:50,693 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:20:50,698 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:20:51,221 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:20:51,697 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:20:51,697 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:20:51,837 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:20:51,838 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:20:51,838 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:20:51,870 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:20:51,872 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:20:51,872 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:21:18,958 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=58, succcessCount=28, totalEvents=108, totalSuccessCount=53 2018-05-02 05:21:20,446 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:21:24,963 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.010 minutes, events=27, succcessCount=27, totalEvents=55, totalSuccessCount=55 2018-05-02 05:22:12,527 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 2018-05-02 05:22:12,534 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525237775059 znode expired, triggering replicatorRemoved event 2018-05-02 05:22:12,535 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:22:12,852 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:22:12,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 05:22:12,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 05:22:12,873 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:22:12,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 05:22:12,873 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:22:12,873 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:22:12,873 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:22:12,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 05:22:12,874 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:22:12,874 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:22:12,875 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 05:22:12,875 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:22:12,875 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:22:12,894 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:22:12,894 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:22:12,896 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:22:12,897 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:22:12,947 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 05:22:12,947 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:22:12,954 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 05:22:12,983 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12144.seqid, newMaxSeqId=12144, maxSeqId=12143 2018-05-02 05:22:12,987 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12144 2018-05-02 05:22:12,991 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:22:12,995 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:22:12,995 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:22:17,875 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:22:17,876 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:22:17,879 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:22:18,383 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:22:18,709 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:22:18,710 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:22:18,782 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:22:18,782 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:22:18,782 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:22:18,788 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:22:18,799 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:22:18,799 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:22:18,963 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=50, succcessCount=25, totalEvents=158, totalSuccessCount=78 2018-05-02 05:22:24,968 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=25, succcessCount=25, totalEvents=80, totalSuccessCount=80 2018-05-02 05:22:48,354 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:23:13,328 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:23:18,965 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=48, succcessCount=24, totalEvents=206, totalSuccessCount=102 2018-05-02 05:23:24,760 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:23:24,762 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:23:24,974 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.006 minutes, events=24, succcessCount=24, totalEvents=104, totalSuccessCount=104 2018-05-02 05:23:51,087 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 2018-05-02 05:23:51,091 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525237780134 znode expired, triggering replicatorRemoved event 2018-05-02 05:23:51,091 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:23:52,527 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:23:52,549 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:23:52,551 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => 63390c1b726b541c3ebd2a1a8679aaf1, NAME => 'test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 05:23:52,552 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AuthenticationService 2018-05-02 05:23:52,552 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:23:52,552 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=SecureBulkLoadService 2018-05-02 05:23:52,553 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:23:52,553 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:23:52,553 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:23:52,553 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AccessControlService 2018-05-02 05:23:52,553 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:23:52,553 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:23:52,553 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 05:23:52,554 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:23:52,554 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:52,555 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:23:52,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => 51c9fc854cbebfa25ed419e23bd8ac74, NAME => 'test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 05:23:52,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AuthenticationService 2018-05-02 05:23:52,558 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:23:52,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=SecureBulkLoadService 2018-05-02 05:23:52,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:23:52,558 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:23:52,558 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:23:52,559 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AccessControlService 2018-05-02 05:23:52,559 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:23:52,559 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:23:52,559 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 05:23:52,560 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:23:52,562 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:52,584 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opening region: {ENCODED => c963eb77dbdc6dbab886dbe4eebba5ad, NAME => 'test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 05:23:52,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AuthenticationService 2018-05-02 05:23:52,585 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:23:52,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=SecureBulkLoadService 2018-05-02 05:23:52,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:23:52,585 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:23:52,585 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:23:52,585 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AccessControlService 2018-05-02 05:23:52,586 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:23:52,586 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:23:52,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 05:23:52,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:23:52,591 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:23:52,599 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 05:23:52,599 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 05:23:52,600 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:23:52,601 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:23:52,611 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 05:23:52,611 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 05:23:52,612 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:23:52,619 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:23:52,645 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 05:23:52,645 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 05:23:52,646 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:23:52,647 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:23:52,709 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf/e3adf874832040dc8950e8c8b53a24c3 2018-05-02 05:23:52,709 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:23:52,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 05:23:52,788 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf/e84e460a6b1849daa9fe3dd7067bbe01 2018-05-02 05:23:52,788 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11515.seqid, newMaxSeqId=11515, maxSeqId=11514 2018-05-02 05:23:52,788 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:23:52,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened 63390c1b726b541c3ebd2a1a8679aaf1; next sequenceid=11515 2018-05-02 05:23:52,806 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 05:23:52,807 INFO [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:23:52,812 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c 2018-05-02 05:23:52,812 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:23:52,815 DEBUG [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:23:52,816 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:23:52,828 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 05:23:52,861 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12282.seqid, newMaxSeqId=12282, maxSeqId=12281 2018-05-02 05:23:52,870 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened 51c9fc854cbebfa25ed419e23bd8ac74; next sequenceid=12282 2018-05-02 05:23:52,888 INFO [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:23:52,894 DEBUG [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:23:52,894 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:23:52,897 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12229.seqid, newMaxSeqId=12229, maxSeqId=12228 2018-05-02 05:23:52,908 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opened c963eb77dbdc6dbab886dbe4eebba5ad; next sequenceid=12229 2018-05-02 05:23:52,917 INFO [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:23:52,922 DEBUG [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:23:52,923 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:23:57,554 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:23:57,555 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:23:57,557 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:23:58,061 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:23:58,381 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:23:58,382 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:23:58,689 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:23:58,689 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:23:58,689 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:23:58,694 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:23:58,697 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:23:58,697 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:24:18,967 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=50, succcessCount=25, totalEvents=256, totalSuccessCount=127 2018-05-02 05:24:24,574 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:24:24,577 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:24:24,578 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:24:24,984 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.010 minutes, events=25, succcessCount=25, totalEvents=129, totalSuccessCount=129 2018-05-02 05:24:25,084 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:24:25,676 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:24:25,677 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:24:25,820 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:24:25,821 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:24:25,821 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:24:25,831 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:24:25,838 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:24:25,838 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:24:32,552 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:25:10,879 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad." 2018-05-02 05:25:10,879 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close c963eb77dbdc6dbab886dbe4eebba5ad, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502. Requested from /172.27.59.154 2018-05-02 05:25:10,880 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:10,882 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing c963eb77dbdc6dbab886dbe4eebba5ad, disabling compactions & flushes 2018-05-02 05:25:10,882 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:25:10,903 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12231.seqid, newMaxSeqId=12231, maxSeqId=12229 2018-05-02 05:25:10,908 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:25:10,908 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:25:10,908 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:25:10,908 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:25:10,908 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding c963eb77dbdc6dbab886dbe4eebba5ad move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 record at close sequenceid=12229 2018-05-02 05:25:10,912 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 05:25:11,125 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:25:11,143 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => 682775c01c8d957d744ae2b280c815cd, NAME => 'test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 05:25:11,143 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=AuthenticationService 2018-05-02 05:25:11,144 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:25:11,144 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=SecureBulkLoadService 2018-05-02 05:25:11,144 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:25:11,144 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:25:11,144 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:25:11,144 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=AccessControlService 2018-05-02 05:25:11,144 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:25:11,145 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:25:11,145 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 682775c01c8d957d744ae2b280c815cd 2018-05-02 05:25:11,145 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:25:11,149 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:11,163 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf 2018-05-02 05:25:11,163 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf 2018-05-02 05:25:11,164 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:25:11,165 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:25:11,186 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf/3dabedf14f6c4208ad17e7be0d53907d 2018-05-02 05:25:11,186 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:25:11,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd 2018-05-02 05:25:11,222 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/recovered.edits/12484.seqid, newMaxSeqId=12484, maxSeqId=12483 2018-05-02 05:25:11,227 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened 682775c01c8d957d744ae2b280c815cd; next sequenceid=12484 2018-05-02 05:25:11,240 INFO [PostOpenDeployTasks:682775c01c8d957d744ae2b280c815cd] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:25:11,244 DEBUG [PostOpenDeployTasks:682775c01c8d957d744ae2b280c815cd] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:25:11,245 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:25:11,588 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1." 2018-05-02 05:25:11,588 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 63390c1b726b541c3ebd2a1a8679aaf1, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606. Requested from /172.27.59.154 2018-05-02 05:25:11,589 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136." 2018-05-02 05:25:11,589 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 1d954f21d711345a9587d995cecea136, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502. Requested from /172.27.59.154 2018-05-02 05:25:11,589 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:11,590 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 63390c1b726b541c3ebd2a1a8679aaf1, disabling compactions & flushes 2018-05-02 05:25:11,590 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:25:11,590 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:11,590 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 05:25:11,590 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:25:11,618 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12535.seqid, newMaxSeqId=12535, maxSeqId=12533 2018-05-02 05:25:11,621 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11517.seqid, newMaxSeqId=11517, maxSeqId=11515 2018-05-02 05:25:11,623 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:25:11,623 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:25:11,623 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:25:11,624 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:25:11,624 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding 1d954f21d711345a9587d995cecea136 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 record at close sequenceid=12533 2018-05-02 05:25:11,625 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:25:11,625 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:25:11,625 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:25:11,625 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:25:11,626 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 63390c1b726b541c3ebd2a1a8679aaf1 move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 record at close sequenceid=11515 2018-05-02 05:25:11,627 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 05:25:11,628 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 05:25:11,816 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11." 2018-05-02 05:25:11,817 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close b5180eee96b616afdf79578309c66a11, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502. Requested from /172.27.59.154 2018-05-02 05:25:11,818 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:11,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 05:25:11,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:25:11,843 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12146.seqid, newMaxSeqId=12146, maxSeqId=12144 2018-05-02 05:25:11,849 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:25:11,849 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:25:11,849 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:25:11,849 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:25:11,849 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding b5180eee96b616afdf79578309c66a11 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 record at close sequenceid=12144 2018-05-02 05:25:11,853 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:25:12,625 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d." 2018-05-02 05:25:12,625 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close c078deb2474e9c19b85b5fdb9efaa47d, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502. Requested from /172.27.59.154 2018-05-02 05:25:12,626 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86." 2018-05-02 05:25:12,626 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 411bd5dbc3845cf91c0d9f4649c84b86, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455. Requested from /172.27.59.154 2018-05-02 05:25:12,626 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:12,626 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing c078deb2474e9c19b85b5fdb9efaa47d, disabling compactions & flushes 2018-05-02 05:25:12,626 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:25:12,627 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:12,627 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 411bd5dbc3845cf91c0d9f4649c84b86, disabling compactions & flushes 2018-05-02 05:25:12,627 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:25:12,661 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/411bd5dbc3845cf91c0d9f4649c84b86/recovered.edits/12582.seqid, newMaxSeqId=12582, maxSeqId=12580 2018-05-02 05:25:12,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11346.seqid, newMaxSeqId=11346, maxSeqId=11344 2018-05-02 05:25:12,667 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:25:12,667 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:25:12,667 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:25:12,667 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:25:12,667 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 411bd5dbc3845cf91c0d9f4649c84b86 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455 record at close sequenceid=12580 2018-05-02 05:25:12,669 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:25:12,669 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:25:12,669 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:25:12,669 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:25:12,669 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding c078deb2474e9c19b85b5fdb9efaa47d move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 record at close sequenceid=11344 2018-05-02 05:25:12,671 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,5c28f5bb,1525237868269.411bd5dbc3845cf91c0d9f4649c84b86. 2018-05-02 05:25:12,672 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 05:25:13,443 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74." 2018-05-02 05:25:13,443 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 51c9fc854cbebfa25ed419e23bd8ac74, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455. Requested from /172.27.59.154 2018-05-02 05:25:13,444 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:25:13,444 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 51c9fc854cbebfa25ed419e23bd8ac74, disabling compactions & flushes 2018-05-02 05:25:13,444 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:25:13,465 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12284.seqid, newMaxSeqId=12284, maxSeqId=12282 2018-05-02 05:25:13,470 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:25:13,470 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:25:13,470 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:25:13,470 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:25:13,470 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 51c9fc854cbebfa25ed419e23bd8ac74 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455 record at close sequenceid=12282 2018-05-02 05:25:13,477 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 05:25:15,908 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:25:15,912 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:25:15,912 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:25:16,417 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:25:16,825 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:25:16,826 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:25:16,927 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:25:16,927 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:25:16,927 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:25:16,934 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:25:16,937 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:25:16,937 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:25:18,975 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.008 minutes, events=54, succcessCount=27, totalEvents=310, totalSuccessCount=154 2018-05-02 05:25:24,989 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=27, succcessCount=27, totalEvents=156, totalSuccessCount=156 2018-05-02 05:26:06,163 DEBUG [RS-EventLoopGroup-1-6] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:26:07,744 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:26:07,751 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:26:09,169 DEBUG [RS-EventLoopGroup-1-7] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:26:12,171 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:26:12,171 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:26:12,171 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:26:12,173 DEBUG [RS-EventLoopGroup-1-8] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:26:12,178 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:26:12,185 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:26:12,185 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:26:12,186 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:26:12,187 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:26:12,187 DEBUG [RS-EventLoopGroup-1-8] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:26:18,999 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.024 minutes, events=50, succcessCount=26, totalEvents=360, totalSuccessCount=180 2018-05-02 05:26:24,994 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=24, succcessCount=24, totalEvents=180, totalSuccessCount=180 2018-05-02 05:27:09,005 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:27:09,009 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:27:09,011 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:27:09,016 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:27:09,016 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:27:09,016 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:27:09,016 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/2 2018-05-02 05:27:09,017 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:27:19,020 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.021 minutes, events=48, succcessCount=24, totalEvents=408, totalSuccessCount=204 2018-05-02 05:27:25,014 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.019 minutes, events=24, succcessCount=24, totalEvents=204, totalSuccessCount=204 2018-05-02 05:27:37,362 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:27:37,371 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:37,371 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,373 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:37,379 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,379 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:37,385 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,386 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:27:37,386 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:37,398 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:37,434 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:37,435 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:37,438 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opening region: {ENCODED => ce3059196e012fe2ffadcb5d2b348ce3, NAME => 'test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:27:37,438 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opening region: {ENCODED => 299ab8318d1b1d267135f988608683b7, NAME => 'test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 05:27:37,439 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:37,439 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AuthenticationService 2018-05-02 05:27:37,439 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AuthenticationService 2018-05-02 05:27:37,439 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,439 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,439 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=SecureBulkLoadService 2018-05-02 05:27:37,439 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=SecureBulkLoadService 2018-05-02 05:27:37,439 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,439 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,439 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,439 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 05:27:37,439 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,440 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:37,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 05:27:37,439 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,441 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,441 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AccessControlService 2018-05-02 05:27:37,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 05:27:37,441 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,441 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,441 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AccessControlService 2018-05-02 05:27:37,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 05:27:37,441 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,442 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,441 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,442 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,442 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,442 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:27:37,442 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 05:27:37,442 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:37,442 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 05:27:37,442 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,442 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 05:27:37,442 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,442 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,442 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,443 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,443 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 299ab8318d1b1d267135f988608683b7 2018-05-02 05:27:37,443 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 05:27:37,442 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,442 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 05:27:37,443 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,443 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:37,443 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,443 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:37,444 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,443 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,449 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 05:27:37,449 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:37,450 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,451 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 05:27:37,452 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 05:27:37,452 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:37,452 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 05:27:37,452 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:37,452 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:37,452 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:37,452 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 05:27:37,453 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:37,453 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:37,453 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 05:27:37,454 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:37,454 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:37,507 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:27:37,508 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:37,508 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,510 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:37,514 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,514 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:37,519 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:37,519 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:27:37,519 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:37,560 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 05:27:37,560 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 05:27:37,561 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=10, currentSize=327.17 KB, freeSize=204.48 MB, maxSize=204.80 MB, heapSize=327.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,562 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,573 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 05:27:37,573 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 05:27:37,574 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,574 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=10, currentSize=327.17 KB, freeSize=204.48 MB, maxSize=204.80 MB, heapSize=327.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,575 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,577 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7 2018-05-02 05:27:37,578 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 05:27:37,578 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 05:27:37,579 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 05:27:37,579 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 05:27:37,579 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=10, currentSize=327.17 KB, freeSize=204.48 MB, maxSize=204.80 MB, heapSize=327.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,580 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=10, currentSize=327.17 KB, freeSize=204.48 MB, maxSize=204.80 MB, heapSize=327.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,580 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,580 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 05:27:37,580 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 05:27:37,581 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,581 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,581 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=10, currentSize=327.17 KB, freeSize=204.48 MB, maxSize=204.80 MB, heapSize=327.17 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:37,582 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:37,584 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,594 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,597 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 05:27:37,600 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:37,603 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 05:27:37,604 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 05:27:37,604 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 05:27:37,661 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,661 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opened 299ab8318d1b1d267135f988608683b7; next sequenceid=2 2018-05-02 05:27:37,665 INFO [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:37,667 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,667 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=2 2018-05-02 05:27:37,668 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,668 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=2 2018-05-02 05:27:37,671 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:37,671 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:37,678 DEBUG [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:37,678 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:27:37,681 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:37,681 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:27:37,682 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:37,682 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:27:37,684 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,684 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=2 2018-05-02 05:27:37,693 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:37,697 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 05:27:37,697 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opened ce3059196e012fe2ffadcb5d2b348ce3; next sequenceid=2 2018-05-02 05:27:37,698 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:37,698 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:27:37,703 INFO [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:37,714 DEBUG [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:37,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:27:37,867 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:27:38,525 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7." 2018-05-02 05:27:38,525 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Close 299ab8318d1b1d267135f988608683b7 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,527 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3." 2018-05-02 05:27:38,527 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Close ce3059196e012fe2ffadcb5d2b348ce3 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,527 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a." 2018-05-02 05:27:38,527 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Close 61e6bada2600d1326224ecb9ae7c237a without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,528 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,528 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 299ab8318d1b1d267135f988608683b7, disabling compactions & flushes 2018-05-02 05:27:38,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:38,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing ce3059196e012fe2ffadcb5d2b348ce3, disabling compactions & flushes 2018-05-02 05:27:38,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:38,529 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 05:27:38,529 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:38,603 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,640 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,640 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,647 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,647 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,647 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,647 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:38,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,654 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:38,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,654 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,654 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:38,672 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:38,672 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:38,675 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:38,684 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2." 2018-05-02 05:27:38,684 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Close bb80fda45cdcaf338a2a3cfb863adfc2 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,685 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951." 2018-05-02 05:27:38,685 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,685 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Close 1595f38ee901be7c67b997fe2fc95951 without moving. Requested from /172.27.61.83 2018-05-02 05:27:38,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 05:27:38,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:38,685 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:38,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 05:27:38,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:38,731 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,731 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=2 2018-05-02 05:27:38,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,750 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:38,762 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:38,765 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:27:38,765 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:27:38,765 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:27:38,766 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:38,781 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:40,677 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:40,713 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:40,714 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:40,714 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:40,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opening region: {ENCODED => 299ab8318d1b1d267135f988608683b7, NAME => 'test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 05:27:40,714 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:40,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AuthenticationService 2018-05-02 05:27:40,714 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=SecureBulkLoadService 2018-05-02 05:27:40,715 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,715 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 05:27:40,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AccessControlService 2018-05-02 05:27:40,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 05:27:40,715 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 299ab8318d1b1d267135f988608683b7 2018-05-02 05:27:40,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:40,716 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 05:27:40,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 05:27:40,718 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 05:27:40,718 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,718 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 05:27:40,718 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,718 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,718 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,718 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 05:27:40,718 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,718 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 05:27:40,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 05:27:40,719 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,719 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 05:27:40,719 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,719 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 05:27:40,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:40,720 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,721 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 05:27:40,721 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,721 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,721 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,721 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 05:27:40,722 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,722 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,722 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 05:27:40,722 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:40,722 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => ce3059196e012fe2ffadcb5d2b348ce3, NAME => 'test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:27:40,723 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AuthenticationService 2018-05-02 05:27:40,723 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:27:40,723 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=SecureBulkLoadService 2018-05-02 05:27:40,723 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:27:40,724 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:27:40,724 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:27:40,724 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AccessControlService 2018-05-02 05:27:40,724 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:27:40,724 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:27:40,724 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 05:27:40,724 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:40,725 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 05:27:40,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:40,739 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:27:40,819 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 05:27:40,819 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 05:27:40,820 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=11, currentSize=354.83 KB, freeSize=204.45 MB, maxSize=204.80 MB, heapSize=354.83 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,821 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,833 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 05:27:40,833 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 05:27:40,834 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=11, currentSize=354.83 KB, freeSize=204.45 MB, maxSize=204.80 MB, heapSize=354.83 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,834 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,839 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 05:27:40,839 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 05:27:40,839 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=11, currentSize=354.83 KB, freeSize=204.45 MB, maxSize=204.80 MB, heapSize=354.83 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,840 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 05:27:40,840 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 05:27:40,840 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 05:27:40,840 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 05:27:40,841 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=11, currentSize=354.83 KB, freeSize=204.45 MB, maxSize=204.80 MB, heapSize=354.83 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,841 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,840 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,842 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,842 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=11, currentSize=354.83 KB, freeSize=204.45 MB, maxSize=204.80 MB, heapSize=354.83 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:27:40,843 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:27:40,845 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,853 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,855 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,868 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:27:40,878 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7 2018-05-02 05:27:40,879 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 05:27:40,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 05:27:40,895 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 05:27:40,906 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 05:27:41,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:41,070 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:41,079 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=5 2018-05-02 05:27:41,084 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:41,085 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:41,090 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/5.seqid, newMaxSeqId=5, maxSeqId=4 2018-05-02 05:27:41,091 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=5 2018-05-02 05:27:41,091 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:41,096 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:41,105 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:27:41,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:27:41,113 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:27:41,113 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:27:41,119 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=5 2018-05-02 05:27:41,122 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened ce3059196e012fe2ffadcb5d2b348ce3; next sequenceid=5 2018-05-02 05:27:41,130 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opened 299ab8318d1b1d267135f988608683b7; next sequenceid=5 2018-05-02 05:27:41,140 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:41,151 INFO [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:41,154 INFO [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:41,170 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:27:41,170 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:27:41,183 DEBUG [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:27:41,184 DEBUG [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:27:41,184 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:27:41,184 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:27:41,981 DEBUG [RS-EventLoopGroup-1-11] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:27:41,984 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:41,984 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:41,987 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:41,992 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:41,992 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:42,002 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:42,002 DEBUG [RS-EventLoopGroup-1-11] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:27:42,003 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:42,442 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:27:42,444 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:27:42,451 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:27:42,966 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:27:43,504 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 191 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:43,506 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 192 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:43,793 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:27:43,793 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:27:44,038 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:27:44,039 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:27:44,039 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:27:44,046 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:27:44,049 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:27:44,049 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:27:44,277 DEBUG [RS-EventLoopGroup-1-12] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:27:44,287 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:27:44,287 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:44,292 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:27:44,301 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:44,301 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:27:44,312 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:27:44,312 DEBUG [RS-EventLoopGroup-1-12] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 05:27:44,312 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:27:47,645 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 340 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:47,645 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 340 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:47,646 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 357 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:47,646 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 358 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:47,648 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 360 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:48,715 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 113 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:48,715 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 116 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:48,715 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 121 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:48,716 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 124 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:48,717 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 126 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:50,312 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 117 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:52,016 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 121 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:52,018 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 121 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:53,894 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 185 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:54,570 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 141 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:54,571 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 134 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:54,571 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 134 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:54,571 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 137 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:54,572 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 132 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:54,634 DEBUG [RS-EventLoopGroup-1-13] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 05:27:55,918 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 296 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:55,920 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 298 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:55,939 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 305 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:55,939 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 308 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:27:57,786 DEBUG [RS-EventLoopGroup-1-14] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 05:27:59,640 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 164 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:00,802 DEBUG [RS-EventLoopGroup-1-15] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 05:28:01,300 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 221 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:01,301 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 218 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:01,307 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 224 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:01,614 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:28:01,625 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:28:02,748 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 112 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:02,749 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 113 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:02,749 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 113 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:02,750 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 111 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:02,750 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 113 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:03,921 DEBUG [RS-EventLoopGroup-1-16] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 05:28:06,929 DEBUG [RS-EventLoopGroup-1-17] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:28:06,935 DEBUG [RS-EventLoopGroup-1-17] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:28:06,943 DEBUG [RS-EventLoopGroup-1-17] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:28:06,944 DEBUG [RS-EventLoopGroup-1-17] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:28:06,945 DEBUG [RS-EventLoopGroup-1-17] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:28:06,946 DEBUG [RS-EventLoopGroup-1-17] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:28:06,946 DEBUG [RS-EventLoopGroup-1-17] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:28:13,330 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=354.83 KB, freeSize=204.45 MB, max=204.80 MB, blockCount=11, accesses=131, hits=120, hitRatio=91.60%, , cachingAccesses=131, cachingHits=120, cachingHitsRatio=91.60%, evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 05:28:13,454 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 123 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:13,455 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 124 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:13,455 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 126 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:13,455 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 124 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:13,456 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 123 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:19,058 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.038 minutes, events=753, succcessCount=277, totalEvents=1161, totalSuccessCount=481 2018-05-02 05:28:24,761 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=7, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:28:24,765 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:28:25,047 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.033 minutes, events=277, succcessCount=277, totalEvents=481, totalSuccessCount=481 2018-05-02 05:28:25,812 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 205 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:26,819 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:26,819 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:26,820 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 100 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:28,135 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 213 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:28,138 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 217 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:28,139 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 220 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:28,139 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 218 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:28,139 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 218 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:29,354 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 179 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:29,356 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 184 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:29,356 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 180 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:29,360 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 183 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:29,360 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 184 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:30,572 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 116 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:31,846 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 257 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:34,154 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 257 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:34,155 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 256 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:34,155 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 255 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:34,155 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 255 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:35,736 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 137 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:35,737 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 138 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:37,409 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 138 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:37,409 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 138 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:37,409 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 139 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:41,133 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 152 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:45,517 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 265 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:45,518 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 265 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:47,215 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 146 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:47,235 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 151 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:47,235 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 152 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:47,236 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 152 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:47,236 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 152 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:50,584 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 344 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:50,585 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 347 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:50,585 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 349 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:50,585 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 348 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:50,593 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 352 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:53,449 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 121 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:54,730 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 215 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:54,734 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 213 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:54,734 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 217 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:56,967 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 264 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:58,409 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 149 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:59,826 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 187 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:59,826 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 189 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:59,828 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 188 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:28:59,828 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 193 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:01,117 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 183 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:01,118 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 183 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:04,215 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 136 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:04,216 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 137 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:04,217 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 138 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:05,707 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 224 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:06,989 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 159 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:06,990 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 161 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:06,990 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 160 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:06,990 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 162 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:06,989 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 161 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:08,295 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 180 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:08,299 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 178 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:09,832 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 246 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:09,832 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 246 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:09,832 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 246 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:09,833 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 247 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:09,838 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 251 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:11,421 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 318 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:11,424 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 320 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:12,547 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 137 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:12,548 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 135 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:12,548 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 135 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:12,548 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 135 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:12,547 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 138 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:13,625 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 127 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:13,625 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 128 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:15,788 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 163 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:15,788 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 163 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:15,788 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 163 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:15,789 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 161 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:15,796 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 168 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:17,170 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 211 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:18,321 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 111 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:18,321 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 111 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:18,321 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 110 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:19,210 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.151 minutes, events=616, succcessCount=275, totalEvents=1777, totalSuccessCount=756 2018-05-02 05:29:19,490 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 150 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:19,491 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 149 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:19,491 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 150 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:19,494 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 152 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:19,496 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 154 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:20,667 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 175 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:20,668 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 176 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:20,668 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 176 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:20,668 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 176 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:22,167 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 117 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:23,971 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 161 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:24,579 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:29:24,593 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:29:24,594 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:29:25,141 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:29:25,398 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.352 minutes, events=300, succcessCount=300, totalEvents=781, totalSuccessCount=781 2018-05-02 05:29:25,401 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 167 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:25,401 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 166 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:25,401 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 166 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:25,401 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 167 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:25,402 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 167 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:25,816 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:29:25,816 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:29:25,979 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 152 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:25,980 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 152 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:25,982 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 148 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:25,982 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 148 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:25,983 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 148 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:26,332 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:29:26,332 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:29:26,332 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:29:26,347 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:29:26,360 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:29:26,360 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:29:29,148 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 104 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:30,509 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 160 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:30,509 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 161 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:33,669 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 120 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:33,669 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 119 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:33,679 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 124 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:33,679 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 124 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:33,679 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 124 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:36,692 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 197 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:36,693 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 196 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:36,693 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 196 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:36,713 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 212 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:36,714 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 212 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:37,774 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 129 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:37,775 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 133 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:37,776 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 132 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:37,777 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 133 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:37,778 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 131 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:44,572 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 348 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:44,572 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 350 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:47,635 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 258 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:47,635 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 259 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:47,636 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 260 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:49,413 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 167 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:51,206 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 199 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:51,207 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 198 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:52,954 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 259 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:56,023 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 260 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:57,138 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 126 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:57,138 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 127 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:57,139 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 126 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:57,141 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 127 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:29:57,141 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 128 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:30:19,211 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=439, succcessCount=231, totalEvents=2216, totalSuccessCount=987 2018-05-02 05:30:25,412 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.014 minutes, events=208, succcessCount=208, totalEvents=989, totalSuccessCount=989 2018-05-02 05:30:31,063 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020. Trying to failover immediately. 2018-05-02 05:30:31,067 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 1 failover attempts. Trying to failover after sleeping for 593ms. 2018-05-02 05:30:31,662 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 2 failover attempts. Trying to failover after sleeping for 1513ms. 2018-05-02 05:30:33,178 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 3 failover attempts. Trying to failover after sleeping for 2793ms. 2018-05-02 05:30:35,974 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 4 failover attempts. Trying to failover after sleeping for 9472ms. 2018-05-02 05:30:45,449 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 5 failover attempts. Trying to failover after sleeping for 17089ms. 2018-05-02 05:31:02,541 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 6 failover attempts. Trying to failover after sleeping for 16394ms. 2018-05-02 05:31:18,938 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 7 failover attempts. Trying to failover after sleeping for 18121ms. 2018-05-02 05:31:19,213 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=48, succcessCount=24, totalEvents=2264, totalSuccessCount=1011 2018-05-02 05:31:25,419 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.007 minutes, events=24, succcessCount=24, totalEvents=1013, totalSuccessCount=1013 2018-05-02 05:31:37,061 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 8 failover attempts. Trying to failover after sleeping for 11387ms. 2018-05-02 05:31:48,452 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 9 failover attempts. Trying to failover after sleeping for 11518ms. 2018-05-02 05:32:00,008 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1222020079_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1222020079_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 12337ms. 2018-05-02 05:32:12,374 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1222020079_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1222020079_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 7721ms. 2018-05-02 05:32:19,214 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=48, succcessCount=24, totalEvents=2312, totalSuccessCount=1035 2018-05-02 05:32:20,100 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1222020079_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1222020079_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 9577ms. 2018-05-02 05:32:25,432 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.013 minutes, events=24, succcessCount=24, totalEvents=1037, totalSuccessCount=1037 2018-05-02 05:32:29,681 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1222020079_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1222020079_1. Name node is in safe mode. The reported blocks 177 needs additional 127 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 16166ms. 2018-05-02 05:32:45,852 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1222020079_1. Name node is in safe mode. The reported blocks 286 needs additional 18 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-1222020079_1. Name node is in safe mode. The reported blocks 286 needs additional 18 blocks to reach the threshold 1.0000 of total blocks 304. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 10 failover attempts. Retrying after sleeping for 17262ms. 2018-05-02 05:33:13,328 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=354.83 KB, freeSize=204.45 MB, max=204.80 MB, blockCount=11, accesses=131, hits=120, hitRatio=91.60%, , cachingAccesses=131, cachingHits=120, cachingHitsRatio=91.60%, evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 05:33:19,218 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=48, succcessCount=24, totalEvents=2360, totalSuccessCount=1059 2018-05-02 05:33:24,760 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=10, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:33:24,762 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:33:25,437 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=24, succcessCount=24, totalEvents=1061, totalSuccessCount=1061 2018-05-02 05:34:19,220 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=48, succcessCount=24, totalEvents=2408, totalSuccessCount=1083 2018-05-02 05:34:24,576 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:34:24,578 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:34:24,582 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:34:25,085 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:34:25,438 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.001 minutes, events=24, succcessCount=24, totalEvents=1085, totalSuccessCount=1085 2018-05-02 05:34:25,448 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:34:25,448 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:34:25,534 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:34:25,535 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:34:25,535 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:34:25,540 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:34:25,542 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:34:25,543 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started Wed May 2 05:35:01 UTC 2018 Terminating regionserver 2018-05-02 05:35:01,037 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 05:35:01,037 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 05:35:01,037 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 05:35:01,038 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 05:35:01,044 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:35:01,053 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 05:35:01,053 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 05:35:01,053 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=35.615 seconds, events=16, succcessCount=16, totalEvents=1101, totalSuccessCount=1101 2018-05-02 05:35:01,053 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:35:01,053 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=41.834 seconds, events=34, succcessCount=18, totalEvents=2442, totalSuccessCount=1101 2018-05-02 05:35:01,053 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 05:35:01,053 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:35:02,038 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 05:35:02,038 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 05:35:02,038 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 05:35:02,038 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:35:02,038 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 1001 milli seconds 2018-05-02 05:35:02,039 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 05:35:02,039 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 05:35:02,039 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:35:02,039 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:35:02,039 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 05:35:02,039 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 05:35:02,039 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427' ***** 2018-05-02 05:35:02,039 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 05:35:02,039 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 05:35:02,039 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 05:35:02,040 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 05:35:02,040 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:35:02,040 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 05:35:02,040 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 05:35:02,040 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 05:35:02,040 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,040 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:35:02,041 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 05:35:02,042 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:02,043 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 05:35:02,043 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 05:35:02,043 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 05:35:02,044 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 05:35:02,044 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 exiting 2018-05-02 05:35:02,065 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:35:02,072 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:35:02,073 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 05:35:02,073 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 05:35:02,076 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 05:35:02,077 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 05:35:02,077 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 05:35:02,077 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 05:35:02,077 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 05:35:02,077 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,079 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,079 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing ce3059196e012fe2ffadcb5d2b348ce3, disabling compactions & flushes 2018-05-02 05:35:02,079 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:35:02,080 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.01 MB memstore heap size=3.02 MB 2018-05-02 05:35:02,094 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,094 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,094 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 05:35:02,095 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:35:02,095 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.00 MB memstore heap size=3.00 MB 2018-05-02 05:35:02,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,095 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,096 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,096 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,096 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 299ab8318d1b1d267135f988608683b7, disabling compactions & flushes 2018-05-02 05:35:02,096 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:35:02,096 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.95 MB memstore heap size=2.93 MB 2018-05-02 05:35:02,096 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:02,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:35:02,098 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 05:35:02,098 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x4c062352 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:35:02,098 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:35:02,098 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 11 regions to close 2018-05-02 05:35:02,869 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.00 MB at sequenceid=12754 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/.tmp/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 05:35:03,025 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/.tmp/test_cf/05473af1c5c04ce588cf168fef810af7 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 05:35:03,134 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7, entries=13849, sequenceid=12754, filesize=2.1 M 2018-05-02 05:35:03,135 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.95 MB at sequenceid=12414 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/.tmp/test_cf/9cc15af02af041c9bb1530abdde14636 2018-05-02 05:35:03,146 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.01 MB at sequenceid=12793 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/.tmp/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf 2018-05-02 05:35:03,216 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Finished memstore flush; data size ~2.00 MB/2100641, heap size ~3.00 MB/3150424, currentsize=0 B/0 for bb80fda45cdcaf338a2a3cfb863adfc2 in 1120ms, sequenceid=12754, compaction requested=false 2018-05-02 05:35:03,218 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/.tmp/test_cf/9cc15af02af041c9bb1530abdde14636 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf/9cc15af02af041c9bb1530abdde14636 2018-05-02 05:35:03,248 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/.tmp/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf 2018-05-02 05:35:03,279 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf/9cc15af02af041c9bb1530abdde14636, entries=13463, sequenceid=12414, filesize=2.0 M 2018-05-02 05:35:03,282 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Finished memstore flush; data size ~1.95 MB/2049012, heap size ~2.93 MB/3069160, currentsize=0 B/0 for 299ab8318d1b1d267135f988608683b7 in 1186ms, sequenceid=12414, compaction requested=false 2018-05-02 05:35:03,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] ipc.RpcServer: callId: 7968 service: ClientService methodName: Get size: 318 connection: 172.27.61.83:37784 deadline: 1525239393297, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:03,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=9,queue=0,port=16020] ipc.RpcServer: callId: 571 service: ClientService methodName: Get size: 318 connection: 172.27.59.154:49226 deadline: 1525239393311, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:03,336 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12757.seqid, newMaxSeqId=12757, maxSeqId=5 2018-05-02 05:35:03,358 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:03,358 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:03,358 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:03,359 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:35:03,359 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:35:03,360 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:03,361 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 05:35:03,361 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:35:03,361 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=1.80 MB memstore heap size=2.70 MB 2018-05-02 05:35:03,386 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf, entries=13882, sequenceid=12793, filesize=2.1 M 2018-05-02 05:35:03,396 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Finished memstore flush; data size ~2.01 MB/2110676, heap size ~3.02 MB/3162752, currentsize=0 B/0 for ce3059196e012fe2ffadcb5d2b348ce3 in 1315ms, sequenceid=12793, compaction requested=false 2018-05-02 05:35:03,421 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/12417.seqid, newMaxSeqId=12417, maxSeqId=5 2018-05-02 05:35:03,443 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:03,443 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:03,443 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:03,443 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:35:03,443 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:35:03,443 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:03,444 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 05:35:03,444 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:35:03,561 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 9 regions to close 2018-05-02 05:35:03,561 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Online Regions={ce3059196e012fe2ffadcb5d2b348ce3=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3., 1595f38ee901be7c67b997fe2fc95951=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951., a6e0d7561c4f19e78f94d37462588281=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281., 5080f353428ccd74e13d5b5493533655=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655., f3db9f9879ed03f488dcb89bea834237=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237., 61e6bada2600d1326224ecb9ae7c237a=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a., 682775c01c8d957d744ae2b280c815cd=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd., ffde9f4a59ab08d4830f3b671f736ad5=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5., 9c38689b653a37956f2ae7364b126f1b=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.} 2018-05-02 05:35:03,583 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12796.seqid, newMaxSeqId=12796, maxSeqId=5 2018-05-02 05:35:03,595 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 126 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:35:03,608 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:03,608 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:03,608 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:03,609 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:35:03,610 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:35:03,610 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:03,610 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 5080f353428ccd74e13d5b5493533655, disabling compactions & flushes 2018-05-02 05:35:03,610 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 05:35:03,611 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Flushing 9/9 column families, memstore data size=9.82 KB memstore heap size=19.10 KB 2018-05-02 05:35:03,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] ipc.RpcServer: callId: 575 service: ClientService methodName: Get size: 318 connection: 172.27.59.154:49226 deadline: 1525239393757, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:03,821 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13454.seqid, newMaxSeqId=13454, maxSeqId=13452 2018-05-02 05:35:03,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] ipc.RpcServer: callId: 7972 service: ClientService methodName: Get size: 318 connection: 172.27.61.83:37784 deadline: 1525239393842, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:03,850 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 05:35:03,858 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:03,858 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:03,858 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:03,858 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:35:03,859 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 05:35:03,859 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:03,859 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 05:35:03,859 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:35:03,988 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12061.seqid, newMaxSeqId=12061, maxSeqId=12059 2018-05-02 05:35:03,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] ipc.RpcServer: callId: 578 service: ClientService methodName: Get size: 318 connection: 172.27.59.154:49226 deadline: 1525239393989, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:04,026 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:04,027 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:04,027 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:04,027 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:35:04,028 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:35:04,028 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:04,029 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 05:35:04,029 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:35:04,029 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.07 MB memstore heap size=3.11 MB 2018-05-02 05:35:04,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] ipc.RpcServer: callId: 7975 service: ClientService methodName: Get size: 318 connection: 172.27.61.83:37784 deadline: 1525239394081, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:04,167 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=1.80 MB at sequenceid=11449 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/.tmp/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 05:35:04,272 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/.tmp/test_cf/158884b033494f66a953da36b7d92646 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 05:35:04,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] ipc.RpcServer: callId: 581 service: ClientService methodName: Get size: 318 connection: 172.27.59.154:49226 deadline: 1525239394328, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:04,418 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646, entries=12443, sequenceid=11449, filesize=1.9 M 2018-05-02 05:35:04,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] ipc.RpcServer: callId: 7978 service: ClientService methodName: Get size: 318 connection: 172.27.61.83:37784 deadline: 1525239394421, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:04,444 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Finished memstore flush; data size ~1.80 MB/1887463, heap size ~2.70 MB/2830040, currentsize=0 B/0 for 1595f38ee901be7c67b997fe2fc95951 in 1082ms, sequenceid=11449, compaction requested=false 2018-05-02 05:35:04,458 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=7.12 KB at sequenceid=1589 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/.tmp/e/70352b92fa4b4ba3aa5203122c0f7562 2018-05-02 05:35:04,562 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 6 regions to close 2018-05-02 05:35:04,563 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Online Regions={1595f38ee901be7c67b997fe2fc95951=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951., 5080f353428ccd74e13d5b5493533655=atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655., 61e6bada2600d1326224ecb9ae7c237a=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a., 682775c01c8d957d744ae2b280c815cd=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd., ffde9f4a59ab08d4830f3b671f736ad5=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5., 9c38689b653a37956f2ae7364b126f1b=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.} 2018-05-02 05:35:04,592 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11452.seqid, newMaxSeqId=11452, maxSeqId=5 2018-05-02 05:35:04,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:04,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:04,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:04,612 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:35:04,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 05:35:04,613 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:04,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 682775c01c8d957d744ae2b280c815cd, disabling compactions & flushes 2018-05-02 05:35:04,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:35:04,650 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] hbase.ScheduledChore: Chore: MemstoreFlusherChore was stopped 2018-05-02 05:35:04,677 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.07 MB at sequenceid=13207 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/.tmp/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 05:35:04,700 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/recovered.edits/12486.seqid, newMaxSeqId=12486, maxSeqId=12484 2018-05-02 05:35:04,717 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:04,717 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:04,717 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:04,717 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:35:04,717 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 05:35:04,718 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:04,718 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing ffde9f4a59ab08d4830f3b671f736ad5, disabling compactions & flushes 2018-05-02 05:35:04,718 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:35:04,805 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.leaseChecker] regionserver.Leases: Closed leases 2018-05-02 05:35:04,808 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.70 KB at sequenceid=1589 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/.tmp/g/f00299b8454c4e9db12271ec4e3266d4 2018-05-02 05:35:04,824 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11982.seqid, newMaxSeqId=11982, maxSeqId=11980 2018-05-02 05:35:04,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:04,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:04,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:04,839 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:35:04,840 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:35:04,840 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:35:04,840 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 9c38689b653a37956f2ae7364b126f1b, disabling compactions & flushes 2018-05-02 05:35:04,840 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:35:04,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] ipc.RpcServer: callId: 584 service: ClientService methodName: Get size: 318 connection: 172.27.59.154:49226 deadline: 1525239394849, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:04,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/.tmp/e/70352b92fa4b4ba3aa5203122c0f7562 as hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/70352b92fa4b4ba3aa5203122c0f7562 2018-05-02 05:35:04,879 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/.tmp/test_cf/344746702cab4e3087c8267fbc018fb6 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 05:35:04,928 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12739.seqid, newMaxSeqId=12739, maxSeqId=12737 2018-05-02 05:35:04,956 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:04,956 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:04,956 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:04,956 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:35:04,956 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:35:05,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] ipc.RpcServer: callId: 7981 service: ClientService methodName: Get size: 318 connection: 172.27.61.83:37784 deadline: 1525239395003, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:05,005 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6, entries=14353, sequenceid=13207, filesize=2.2 M 2018-05-02 05:35:05,011 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Finished memstore flush; data size ~2.07 MB/2171635, heap size ~3.11 MB/3259024, currentsize=0 B/0 for 61e6bada2600d1326224ecb9ae7c237a in 982ms, sequenceid=13207, compaction requested=false 2018-05-02 05:35:05,036 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/e/70352b92fa4b4ba3aa5203122c0f7562, entries=74, sequenceid=1589, filesize=6.3 K 2018-05-02 05:35:05,048 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/.tmp/g/f00299b8454c4e9db12271ec4e3266d4 as hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/f00299b8454c4e9db12271ec4e3266d4 2018-05-02 05:35:05,153 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/g/f00299b8454c4e9db12271ec4e3266d4, entries=41, sequenceid=1589, filesize=5.7 K 2018-05-02 05:35:05,162 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13210.seqid, newMaxSeqId=13210, maxSeqId=5 2018-05-02 05:35:05,163 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Finished memstore flush; data size ~9.82 KB/10055, heap size ~19.52 KB/19992, currentsize=0 B/0 for 5080f353428ccd74e13d5b5493533655 in 1553ms, sequenceid=1589, compaction requested=true 2018-05-02 05:35:05,178 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:05,178 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:05,178 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:05,178 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:35:05,179 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 05:35:05,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/atlas_janus/5080f353428ccd74e13d5b5493533655/recovered.edits/1592.seqid, newMaxSeqId=1592, maxSeqId=1585 2018-05-02 05:35:05,357 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:35:05,358 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:35:05,358 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:05,358 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 05:35:05,358 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed atlas_janus,,1525237229778.5080f353428ccd74e13d5b5493533655. 2018-05-02 05:35:05,366 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427; all regions closed. 2018-05-02 05:35:05,367 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:35:05,866 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 05:35:05,866 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525238287427:(num 1525238308066) 2018-05-02 05:35:05,866 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:35:05,868 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Leases: Closed leases 2018-05-02 05:35:05,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=23,queue=2,port=16020] ipc.RpcServer: callId: 587 service: ClientService methodName: Get size: 318 connection: 172.27.59.154:49226 deadline: 1525239395868, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 stopping 2018-05-02 05:35:05,869 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 05:35:05,869 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 05:35:05,870 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 05:35:05,870 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 05:35:05,870 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 05:35:05,876 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.NettyRpcServer: Stopping server on /172.27.70.95:16020 2018-05-02 05:35:05,877 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 05:35:05,877 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 05:35:05,946 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427 2018-05-02 05:35:05,946 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b279006c, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:35:05,948 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:35:05,948 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ZooKeeper: Session: 0x3631f08b279006c closed 2018-05-02 05:35:05,948 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525238287427; zookeeper connection closed. 2018-05-02 05:35:05,948 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 05:35:05,950 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 05:35:29 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000002.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1031588 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 05:35:33,364 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 05:35:33,369 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 05:35:33,369 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 05:35:33,370 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 05:35:33,370 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 05:35:34,331 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 05:35:34,331 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 05:35:34,331 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 05:35:34,331 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 05:35:34,333 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 05:35:34,333 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 05:35:34,334 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 05:35:34,334 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:35:34,334 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 05:35:34,334 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 05:35:34,334 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 05:35:34,334 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:35:34,334 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 05:35:34,334 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 05:35:34,334 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 05:35:34,334 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 05:35:34,335 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 05:35:34,335 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 05:35:34,335 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 05:35:34,336 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 05:35:34,336 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 05:35:34,336 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 05:35:34,336 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 05:35:34,336 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 05:35:34,337 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 05:35:34,337 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 05:35:34,338 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 05:35:34,338 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020535 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 05:35:34,338 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 05:35:34,338 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 05:35:34,338 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 05:35:34,338 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log 2018-05-02 05:35:34,338 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 05:35:34,338 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 05:35:34,339 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 05:35:34,340 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 05:35:34,340 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=409596 2018-05-02 05:35:34,340 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:35:34,340 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 05:35:34,340 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 05:35:34,340 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 05:35:34,340 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 05:35:34,340 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:35:34,340 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 05:35:34,340 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 05:35:34,356 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 05:35:34,359 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020535 2018-05-02 05:35:34,360 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 05:35:34,360 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 05:35:34,360 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:35:34,360 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 05:35:34,360 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 05:35:34,360 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 05:35:34,361 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 05:35:34,361 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 05:35:34,361 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 05:35:34,364 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 05:35:34,365 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020535, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 05:35:34,746 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:35:35,685 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 05:35:35,894 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:35:36,840 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:35:36,849 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:35:37,626 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:35:37,626 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:35:37,626 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:35:37,734 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:35:38,144 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:35:38,144 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:35:38,244 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 05:35:39,104 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 server-side Connection retries=105 2018-05-02 05:35:39,133 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:35:39,137 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 05:35:39,137 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 05:35:39,137 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 05:35:39,145 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:35:39,146 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 05:35:39,430 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 05:35:39,759 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 05:35:39,782 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 05:35:39,951 INFO [main] ipc.NettyRpcServer: Bind to /172.27.70.95:16020 2018-05-02 05:35:40,263 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 05:35:40,267 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:35:40,269 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 05:35:40,282 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:35:40,283 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:35:40,289 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 05:35:42,437 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:35:42,455 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 05:35:42,566 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:35:42,577 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 05:35:42,577 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:35:42,577 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 05:35:42,577 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 05:35:42,577 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 05:35:42,578 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 05:35:42,579 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 05:35:42,579 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 05:35:42,579 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 05:35:42,579 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 05:35:42,579 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 05:35:42,579 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=4.15.12-1.el7.elrepo.x86_64 2018-05-02 05:35:42,579 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 05:35:42,579 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 05:35:42,579 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 05:35:42,581 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 05:35:42,624 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 05:35:42,627 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 05:35:42,650 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:35:42,650 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 05:35:42 UTC 2018 2018-05-02 05:35:42,650 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 05:35:42 UTC 2018 2018-05-02 05:35:42,651 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 01:51:58 UTC 2018 2018-05-02 05:35:42,667 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:35:42,687 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:35:42,704 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d939007b, negotiated timeout = 90000 2018-05-02 05:35:42,708 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 05:35:42,710 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b connected 2018-05-02 05:35:42,761 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 05:35:42,901 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:35:42,901 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:35:42,901 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:35:42,913 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:35:43,025 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 05:35:43,074 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 05:35:43,079 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 05:35:43,122 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 05:35:43,156 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 05:35:43,412 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 05:35:43,412 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 05:35:43,412 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 05:35:43,455 INFO [main] util.log: Logging initialized @11790ms 2018-05-02 05:35:43,573 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 05:35:43,595 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 05:35:43,596 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 05:35:43,599 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 05:35:43,600 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 05:35:43,600 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 05:35:43,651 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 05:35:43,654 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 05:35:43,714 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 05:35:43,715 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 05:35:43,926 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:35:43,935 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000002.hwx.site,h=[ctr-e138-1518143905142-279227-01-000002.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 05:35:43,958 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:35:43,958 INFO [main] server.Server: Started @12294ms 2018-05-02 05:35:44,003 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 05:35:44,010 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 05:35:44,043 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 05:35:44,043 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 05:35:44,050 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 05:35:44,081 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Connect 0x71d0aebb to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 05:35:44,094 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x71d0aebb] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/835391867@74c98926 2018-05-02 05:35:44,095 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x71d0aebb-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:35:44,097 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x71d0aebb-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:35:44,097 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x71d0aebb-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 05:35:44,102 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x71d0aebb-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d939007c, negotiated timeout = 90000 2018-05-02 05:35:44,143 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@203c978, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 05:35:44,145 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e226321, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:0 2018-05-02 05:35:44,152 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000002:16020 2018-05-02 05:35:44,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 05:35:44,165 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 05:35:44,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 05:35:44,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 05:35:44,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:35:44,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 05:35:44,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:35:44,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 05:35:44,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:35:44,184 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 05:35:44,185 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 05:35:44,185 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 05:35:44,185 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 05:35:44,185 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 05:35:44,370 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 05:35:44,373 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 05:35:44,379 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 05:35:44,379 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 05:35:44,383 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 05:35:44,384 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 05:35:44,439 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 05:35:44,440 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 05:35:44,453 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 05:35:44,454 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: init() called 2018-05-02 05:35:44,454 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:35:44,454 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 05:35:44,454 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 05:35:44,454 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 05:35:44,455 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 05:35:44,455 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:35:44,455 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 05:35:44,464 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 05:35:44,464 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 05:35:44,464 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 05:35:44,464 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 05:35:44,515 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 05:35:44,553 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 05:35:44,553 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 05:35:44,554 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:35:44,554 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:35:44,554 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 05:35:44,554 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 05:35:44,555 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 05:35:44,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 05:35:44,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 05:35:44,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 05:35:44,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 05:35:44,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 05:35:44,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 05:35:44,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 05:35:44,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 05:35:44,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 05:35:44,561 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 05:35:44,561 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 05:35:44,561 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 05:35:44,561 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 05:35:44,563 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:35:44,563 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:35:44,563 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 05:35:44,563 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 05:35:44,563 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 05:35:44,563 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 05:35:44,564 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 05:35:44,564 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 05:35:44,564 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 05:35:44,564 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 05:35:44,565 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 05:35:44,565 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 05:35:44,565 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 05:35:44,569 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:35:44,572 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:35:44,572 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 05:35:44,793 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:35:45,156 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:35:48,367 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:35:48,370 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 05:35:49,829 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 05:35:50,028 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 05:35:50,028 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:35:50,028 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 05:35:50,030 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 05:35:50,033 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 05:35:50,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525238791399 with port=16020, startcode=1525239334474 2018-05-02 05:35:50,347 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:35:50,354 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:35:50,355 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:35:50,646 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:35:50,681 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:35:50,728 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:35:50,732 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:35:50,734 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:35:50,735 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:35:50,735 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:35:50,816 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 05:35:50,817 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 05:35:50,817 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 05:35:50,875 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:35:50,896 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:35:51,231 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 05:35:51,265 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 05:35:51,390 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 05:35:51,416 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 05:35:51,438 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 05:35:51,493 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 05:35:51,792 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:35:51,792 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:35:51,792 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:35:51,792 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 05:35:51,793 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 05:35:51,793 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 05:35:51,793 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 05:35:51,821 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 05:35:52,202 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 05:35:52,210 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 05:35:52,215 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 starting 2018-05-02 05:35:52,216 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 05:35:52,234 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 05:35:52,236 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 05:35:52,252 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474] other RSs: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474] 2018-05-02 05:35:52,382 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474, RpcServer on ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:16020, sessionid=0x2631f08d939007b 2018-05-02 05:35:52,382 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 05:35:52,382 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:35:52,382 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474' 2018-05-02 05:35:52,383 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 05:35:52,384 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 05:35:52,385 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 05:35:52,385 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 05:35:52,385 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:35:52,385 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474' 2018-05-02 05:35:52,385 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 05:35:52,387 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 05:35:52,388 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 05:35:52,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 05:35:52,388 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 05:35:55,500 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:35:55,925 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Slow sync cost: 291 ms, current pipeline: [] 2018-05-02 05:35:55,930 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474.1525239355501 2018-05-02 05:35:55,931 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK]] 2018-05-02 05:36:42,938 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245 2018-05-02 05:36:42,943 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525238381245 znode expired, triggering replicatorRemoved event 2018-05-02 05:36:42,946 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:36:44,228 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x71d0aebb] zookeeper.ZooKeeper: Session: 0x2631f08d939007c closed 2018-05-02 05:36:44,229 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x71d0aebb-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:37:21,798 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:38:17,996 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:38:17,997 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 05:38:18,000 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:38:18,001 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:38:18,013 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:38:18,014 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:18,016 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:38:18,017 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:38:18,017 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:38:18,017 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 05:38:18,017 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/3 2018-05-02 05:38:18,017 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:38:18,018 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455 2018-05-02 05:38:18,021 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525238470455 znode expired, triggering replicatorRemoved event 2018-05-02 05:38:18,021 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:38:18,548 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:38:18,553 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:38:18,554 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:38:18,568 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:38:18,579 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:38:18,580 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:38:18,581 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:38:18,582 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:38:18,583 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:38:18,742 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:38:18,888 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:38:18,906 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:38:18,925 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:18,927 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:38:18,928 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:38:18,934 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 94f6ca283dbb4445b2bcdc321b734d28, NAME => 'test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 05:38:18,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => 299ab8318d1b1d267135f988608683b7, NAME => 'test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 05:38:18,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => da9e02fc1fdd80392463141e6bc6cf96, NAME => 'test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 05:38:18,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => 2fd8c4d5abf9928da8e8c547a0ca223a, NAME => 'test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 05:38:18,935 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => a8ff96226d546f0ea151823ae73e5a1b, NAME => 'test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 05:38:18,936 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => 4c37ee7a4e1210e481debdc2933fc4d2, NAME => 'test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2.', STARTKEY => '147ae146', ENDKEY => '1eb851e9'} 2018-05-02 05:38:19,029 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AuthenticationService 2018-05-02 05:38:19,036 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=AuthenticationService 2018-05-02 05:38:19,036 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:19,037 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AuthenticationService 2018-05-02 05:38:19,037 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AuthenticationService 2018-05-02 05:38:19,038 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AuthenticationService 2018-05-02 05:38:19,038 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AuthenticationService 2018-05-02 05:38:19,041 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:19,041 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:19,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:19,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=SecureBulkLoadService 2018-05-02 05:38:19,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=SecureBulkLoadService 2018-05-02 05:38:19,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:19,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=SecureBulkLoadService 2018-05-02 05:38:19,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=SecureBulkLoadService 2018-05-02 05:38:19,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:19,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:19,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=SecureBulkLoadService 2018-05-02 05:38:19,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:19,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:19,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:19,045 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:19,045 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:19,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. service=AccessControlService 2018-05-02 05:38:19,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. service=AccessControlService 2018-05-02 05:38:19,046 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:19,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:19,047 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:19,047 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:19,047 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AccessControlService 2018-05-02 05:38:19,047 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:19,047 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:19,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:19,048 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:19,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:19,048 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:19,046 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:19,046 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:19,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=SecureBulkLoadService 2018-05-02 05:38:19,049 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:19,049 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:19,050 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AccessControlService 2018-05-02 05:38:19,050 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:19,050 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:19,048 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:19,051 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AccessControlService 2018-05-02 05:38:19,049 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:19,051 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:19,051 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:19,051 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:19,051 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. service=AccessControlService 2018-05-02 05:38:19,051 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:19,052 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:19,052 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:19,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 05:38:19,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:38:19,134 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 05:38:19,134 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:38:19,135 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 05:38:19,135 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:38:19,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 4c37ee7a4e1210e481debdc2933fc4d2 2018-05-02 05:38:19,142 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:38:19,142 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 05:38:19,142 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:19,147 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 299ab8318d1b1d267135f988608683b7 2018-05-02 05:38:19,147 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:38:19,168 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:19,168 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:19,169 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:19,169 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:19,169 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:19,169 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:19,398 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 05:38:19,398 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 05:38:19,398 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 05:38:19,398 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf 2018-05-02 05:38:19,398 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf 2018-05-02 05:38:19,399 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf 2018-05-02 05:38:19,417 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 05:38:19,417 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 05:38:19,417 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 05:38:19,417 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf 2018-05-02 05:38:19,446 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 05:38:19,446 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 05:38:19,473 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:19,473 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:19,476 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:19,476 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:19,477 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:19,480 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:19,503 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:19,503 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:19,535 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:19,536 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:19,538 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:19,538 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:20,046 DEBUG [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/test_cf/719182bd2f5b43a9b5002dd5ebd23549 2018-05-02 05:38:20,046 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf/e1e7eacb3d0945eabdc05f9612dcf1a3 2018-05-02 05:38:20,046 DEBUG [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/test_cf/5524750f28964bae9802836f5884fdd1 2018-05-02 05:38:20,046 DEBUG [StoreOpener-299ab8318d1b1d267135f988608683b7-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/test_cf/9cc15af02af041c9bb1530abdde14636 2018-05-02 05:38:20,048 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf/0ccbc430bfe6442db21c7e11d482c2f8 2018-05-02 05:38:20,048 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf/99bf1b2ad42a4ca9af12e2d310e96ee0 2018-05-02 05:38:20,052 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:20,052 INFO [StoreOpener-da9e02fc1fdd80392463141e6bc6cf96-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:20,053 INFO [StoreOpener-4c37ee7a4e1210e481debdc2933fc4d2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:20,054 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:20,054 INFO [StoreOpener-299ab8318d1b1d267135f988608683b7-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:20,054 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:20,093 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96 2018-05-02 05:38:20,104 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2 2018-05-02 05:38:20,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7 2018-05-02 05:38:20,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 05:38:20,109 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 05:38:20,113 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 05:38:20,201 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/recovered.edits/12230.seqid, newMaxSeqId=12230, maxSeqId=12229 2018-05-02 05:38:20,201 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/299ab8318d1b1d267135f988608683b7/recovered.edits/12421.seqid, newMaxSeqId=12421, maxSeqId=12420 2018-05-02 05:38:20,201 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13395.seqid, newMaxSeqId=13395, maxSeqId=13394 2018-05-02 05:38:20,206 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12311.seqid, newMaxSeqId=12311, maxSeqId=12310 2018-05-02 05:38:20,207 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11439.seqid, newMaxSeqId=11439, maxSeqId=11438 2018-05-02 05:38:20,209 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 94f6ca283dbb4445b2bcdc321b734d28; next sequenceid=13395 2018-05-02 05:38:20,209 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened 299ab8318d1b1d267135f988608683b7; next sequenceid=12421 2018-05-02 05:38:20,212 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened 4c37ee7a4e1210e481debdc2933fc4d2; next sequenceid=12230 2018-05-02 05:38:20,212 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/da9e02fc1fdd80392463141e6bc6cf96/recovered.edits/12744.seqid, newMaxSeqId=12744, maxSeqId=12743 2018-05-02 05:38:20,212 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened 2fd8c4d5abf9928da8e8c547a0ca223a; next sequenceid=12311 2018-05-02 05:38:20,212 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened a8ff96226d546f0ea151823ae73e5a1b; next sequenceid=11439 2018-05-02 05:38:20,218 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened da9e02fc1fdd80392463141e6bc6cf96; next sequenceid=12744 2018-05-02 05:38:20,271 INFO [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:38:20,271 INFO [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:38:20,273 INFO [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:38:20,273 INFO [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:20,278 INFO [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:38:20,286 INFO [PostOpenDeployTasks:4c37ee7a4e1210e481debdc2933fc4d2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:38:20,303 DEBUG [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:20,303 DEBUG [PostOpenDeployTasks:299ab8318d1b1d267135f988608683b7] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:38:20,304 DEBUG [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:38:20,304 DEBUG [PostOpenDeployTasks:da9e02fc1fdd80392463141e6bc6cf96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:38:20,304 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:20,304 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:20,305 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:20,305 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:20,305 DEBUG [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:38:20,305 DEBUG [PostOpenDeployTasks:4c37ee7a4e1210e481debdc2933fc4d2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:38:20,305 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:20,305 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:20,634 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@59768bdb 2018-05-02 05:38:20,637 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 05:38:20,638 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 05:38:20,639 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 05:38:20,643 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b279007f, negotiated timeout = 10000 2018-05-02 05:38:20,699 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 05:38:20,708 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 05:38:21,386 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:38:21,387 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:38:24,127 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:38:24,129 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:38:24,131 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:38:24,641 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:38:25,117 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:38:25,117 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:38:25,253 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:38:25,253 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:38:25,253 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:38:25,262 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:38:25,265 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:38:25,265 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:38:28,193 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:28,193 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 05:38:28,194 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:28,194 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 05:38:28,194 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:28,194 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 05:38:44,593 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=4, succcessCount=2, totalEvents=4, totalSuccessCount=2 2018-05-02 05:38:48,022 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:38:48,043 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => 78e8a528d65332a4f7661e8ab427a827, NAME => 'test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:38:48,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AuthenticationService 2018-05-02 05:38:48,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:48,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=SecureBulkLoadService 2018-05-02 05:38:48,044 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:48,044 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:48,044 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:48,044 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. service=AccessControlService 2018-05-02 05:38:48,045 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:48,045 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:48,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:38:48,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:38:48,046 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:48,068 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:38:48,069 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf 2018-05-02 05:38:48,071 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:48,072 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:48,110 DEBUG [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/test_cf/8fa92c4235cd4abea8812b60b038dcf2 2018-05-02 05:38:48,110 INFO [StoreOpener-78e8a528d65332a4f7661e8ab427a827-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:48,128 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827 2018-05-02 05:38:48,173 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/78e8a528d65332a4f7661e8ab427a827/recovered.edits/12788.seqid, newMaxSeqId=12788, maxSeqId=12787 2018-05-02 05:38:48,181 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened 78e8a528d65332a4f7661e8ab427a827; next sequenceid=12788 2018-05-02 05:38:48,185 INFO [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:38:48,188 DEBUG [PostOpenDeployTasks:78e8a528d65332a4f7661e8ab427a827] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:38:48,189 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:49,173 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:38:49,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 05:38:49,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 05:38:49,193 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:49,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 05:38:49,193 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:49,193 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:49,193 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:49,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 05:38:49,193 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:49,193 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:49,194 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:38:49,194 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:38:49,194 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:49,222 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:38:49,222 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 05:38:49,224 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:49,224 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:49,305 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 05:38:49,306 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:49,315 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 05:38:49,355 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12988.seqid, newMaxSeqId=12988, maxSeqId=12987 2018-05-02 05:38:49,363 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=12988 2018-05-02 05:38:49,368 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:38:49,373 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:38:49,373 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:51,477 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:38:51,488 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 05:38:51,488 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 05:38:51,489 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:51,489 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 05:38:51,489 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:51,489 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:51,489 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:51,489 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 05:38:51,490 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:51,490 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:51,490 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 05:38:51,490 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:38:51,491 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:51,514 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 05:38:51,514 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 05:38:51,515 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:51,516 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:51,556 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 05:38:51,557 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:51,564 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 05:38:51,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12761.seqid, newMaxSeqId=12761, maxSeqId=12760 2018-05-02 05:38:51,598 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=12761 2018-05-02 05:38:51,603 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:38:51,607 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:38:51,607 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:51,906 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:38:53,046 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:38:53,048 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:38:53,054 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:38:53,561 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:38:53,885 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:38:53,885 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:38:53,977 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:38:53,977 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:38:53,977 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:38:53,985 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:38:53,988 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:38:53,988 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:38:55,157 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:38:55,179 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => ce3059196e012fe2ffadcb5d2b348ce3, NAME => 'test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 05:38:55,180 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AuthenticationService 2018-05-02 05:38:55,180 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:55,180 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=SecureBulkLoadService 2018-05-02 05:38:55,180 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:55,180 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:55,180 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:55,181 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AccessControlService 2018-05-02 05:38:55,181 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:55,181 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:55,181 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 05:38:55,181 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:38:55,182 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:55,201 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 05:38:55,201 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 05:38:55,202 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:55,204 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:55,250 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf 2018-05-02 05:38:55,250 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:55,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 05:38:55,313 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12800.seqid, newMaxSeqId=12800, maxSeqId=12799 2018-05-02 05:38:55,320 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened ce3059196e012fe2ffadcb5d2b348ce3; next sequenceid=12800 2018-05-02 05:38:55,324 INFO [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:38:55,328 DEBUG [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:38:55,329 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:55,464 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:38:55,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => a0792481dc7d859b1b63b04bf9adad81, NAME => 'test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 05:38:55,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AuthenticationService 2018-05-02 05:38:55,477 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:55,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=SecureBulkLoadService 2018-05-02 05:38:55,477 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:55,478 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:55,478 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:55,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. service=AccessControlService 2018-05-02 05:38:55,479 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:55,479 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:55,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0792481dc7d859b1b63b04bf9adad81 2018-05-02 05:38:55,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:38:55,480 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:55,521 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 05:38:55,521 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf 2018-05-02 05:38:55,522 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:55,523 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:55,569 DEBUG [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/test_cf/273e08be6b9245749007d7ffc22c666d 2018-05-02 05:38:55,569 INFO [StoreOpener-a0792481dc7d859b1b63b04bf9adad81-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:55,578 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81 2018-05-02 05:38:55,613 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0792481dc7d859b1b63b04bf9adad81/recovered.edits/11950.seqid, newMaxSeqId=11950, maxSeqId=11949 2018-05-02 05:38:55,622 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened a0792481dc7d859b1b63b04bf9adad81; next sequenceid=11950 2018-05-02 05:38:55,625 INFO [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:38:55,630 DEBUG [PostOpenDeployTasks:a0792481dc7d859b1b63b04bf9adad81] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:38:55,630 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:56,280 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:38:56,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 05:38:56,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 05:38:56,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:56,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 05:38:56,295 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:56,295 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:56,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:56,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 05:38:56,295 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:56,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:56,296 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:38:56,296 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:38:56,296 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:56,308 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:38:56,308 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 05:38:56,309 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:56,310 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:56,335 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 05:38:56,336 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:56,342 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 05:38:56,367 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/11986.seqid, newMaxSeqId=11986, maxSeqId=11985 2018-05-02 05:38:56,373 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=11986 2018-05-02 05:38:56,377 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:38:56,382 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:38:56,382 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:56,564 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:38:56,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opening region: {ENCODED => 84c55bda386b9aa62a8b4df75ca9b38c, NAME => 'test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 05:38:56,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AuthenticationService 2018-05-02 05:38:56,624 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:56,624 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=SecureBulkLoadService 2018-05-02 05:38:56,624 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:56,624 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:56,624 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:56,624 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AccessControlService 2018-05-02 05:38:56,624 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:56,624 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:56,624 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 05:38:56,624 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:38:56,625 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:56,643 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 05:38:56,643 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 05:38:56,644 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:56,645 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:56,684 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf/e85dca4d9952403a8e861bb27c95db92 2018-05-02 05:38:56,684 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:56,694 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 05:38:56,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11877.seqid, newMaxSeqId=11877, maxSeqId=11876 2018-05-02 05:38:56,738 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opened 84c55bda386b9aa62a8b4df75ca9b38c; next sequenceid=11877 2018-05-02 05:38:56,742 INFO [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:38:56,745 DEBUG [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:38:56,746 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:57,404 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:38:57,418 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => 735f841820ff0baa687bc402b169f4a6, NAME => 'test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 05:38:57,419 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AuthenticationService 2018-05-02 05:38:57,419 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:57,419 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=SecureBulkLoadService 2018-05-02 05:38:57,419 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:57,419 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:57,419 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:57,420 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AccessControlService 2018-05-02 05:38:57,420 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:57,420 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:57,420 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 735f841820ff0baa687bc402b169f4a6 2018-05-02 05:38:57,420 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:38:57,421 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:57,451 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 05:38:57,451 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 05:38:57,452 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:57,453 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:57,488 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf/701b265951a9459fbb2a9068086da9e9 2018-05-02 05:38:57,489 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:57,497 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6 2018-05-02 05:38:57,539 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12230.seqid, newMaxSeqId=12230, maxSeqId=12229 2018-05-02 05:38:57,549 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened 735f841820ff0baa687bc402b169f4a6; next sequenceid=12230 2018-05-02 05:38:57,553 INFO [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:38:57,557 DEBUG [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:38:57,557 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:58,378 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:38:58,386 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:38:58,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opening region: {ENCODED => 26d4b78c3c7d2fdea4d32bb21a3ca5fe, NAME => 'test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe.', STARTKEY => 'd70a3d5f', ENDKEY => 'e147ae02'} 2018-05-02 05:38:58,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=AuthenticationService 2018-05-02 05:38:58,387 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:58,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=SecureBulkLoadService 2018-05-02 05:38:58,387 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:58,387 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:58,387 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:58,390 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. service=AccessControlService 2018-05-02 05:38:58,390 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:58,390 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:58,391 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 26d4b78c3c7d2fdea4d32bb21a3ca5fe 2018-05-02 05:38:58,391 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:38:58,391 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:58,394 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opening region: {ENCODED => 9c38689b653a37956f2ae7364b126f1b, NAME => 'test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 05:38:58,394 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AuthenticationService 2018-05-02 05:38:58,395 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:38:58,395 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=SecureBulkLoadService 2018-05-02 05:38:58,395 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:38:58,395 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:38:58,395 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:38:58,395 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AccessControlService 2018-05-02 05:38:58,395 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:38:58,396 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:38:58,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 9c38689b653a37956f2ae7364b126f1b 2018-05-02 05:38:58,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:38:58,396 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b." 2018-05-02 05:38:58,396 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:58,404 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf 2018-05-02 05:38:58,404 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf 2018-05-02 05:38:58,405 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:58,406 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:58,409 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 05:38:58,409 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 05:38:58,410 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:38:58,411 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:38:58,415 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close a8ff96226d546f0ea151823ae73e5a1b, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606. Requested from /172.27.59.154 2018-05-02 05:38:58,418 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:58,418 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing a8ff96226d546f0ea151823ae73e5a1b, disabling compactions & flushes 2018-05-02 05:38:58,418 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:58,431 DEBUG [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/test_cf/6a8aa66cb5364117a56e66c694e2a7f7 2018-05-02 05:38:58,432 INFO [StoreOpener-26d4b78c3c7d2fdea4d32bb21a3ca5fe-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:58,440 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe 2018-05-02 05:38:58,444 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf/e5a8c5ffbf754c8796432534239a0e81 2018-05-02 05:38:58,444 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:38:58,451 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b 2018-05-02 05:38:58,465 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/26d4b78c3c7d2fdea4d32bb21a3ca5fe/recovered.edits/12403.seqid, newMaxSeqId=12403, maxSeqId=12402 2018-05-02 05:38:58,468 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11441.seqid, newMaxSeqId=11441, maxSeqId=11439 2018-05-02 05:38:58,470 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opened 26d4b78c3c7d2fdea4d32bb21a3ca5fe; next sequenceid=12403 2018-05-02 05:38:58,473 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:58,474 INFO [PostOpenDeployTasks:26d4b78c3c7d2fdea4d32bb21a3ca5fe] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:38:58,474 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:58,475 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:58,476 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:58,476 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding a8ff96226d546f0ea151823ae73e5a1b move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 record at close sequenceid=11439 2018-05-02 05:38:58,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12746.seqid, newMaxSeqId=12746, maxSeqId=12745 2018-05-02 05:38:58,479 DEBUG [PostOpenDeployTasks:26d4b78c3c7d2fdea4d32bb21a3ca5fe] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:38:58,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:58,480 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 05:38:58,484 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opened 9c38689b653a37956f2ae7364b126f1b; next sequenceid=12746 2018-05-02 05:38:58,487 INFO [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:38:58,490 DEBUG [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:38:58,491 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:38:59,285 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28." 2018-05-02 05:38:59,285 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 94f6ca283dbb4445b2bcdc321b734d28, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502. Requested from /172.27.59.154 2018-05-02 05:38:59,286 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2." 2018-05-02 05:38:59,286 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 4c37ee7a4e1210e481debdc2933fc4d2, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826. Requested from /172.27.59.154 2018-05-02 05:38:59,286 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:59,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 94f6ca283dbb4445b2bcdc321b734d28, disabling compactions & flushes 2018-05-02 05:38:59,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:38:59,287 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:38:59,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 4c37ee7a4e1210e481debdc2933fc4d2, disabling compactions & flushes 2018-05-02 05:38:59,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:38:59,317 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/4c37ee7a4e1210e481debdc2933fc4d2/recovered.edits/12232.seqid, newMaxSeqId=12232, maxSeqId=12230 2018-05-02 05:38:59,320 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13397.seqid, newMaxSeqId=13397, maxSeqId=13395 2018-05-02 05:38:59,323 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:59,323 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:59,323 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:59,323 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:38:59,323 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 4c37ee7a4e1210e481debdc2933fc4d2 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 record at close sequenceid=12230 2018-05-02 05:38:59,326 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:38:59,326 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:38:59,326 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:38:59,326 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,147ae146,1525237868269.4c37ee7a4e1210e481debdc2933fc4d2. 2018-05-02 05:38:59,327 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:38:59,327 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 94f6ca283dbb4445b2bcdc321b734d28 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 record at close sequenceid=13395 2018-05-02 05:38:59,329 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:39:00,182 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:39:00,183 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:39:00,185 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:39:00,690 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:39:00,957 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:39:00,958 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:39:01,043 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:39:01,043 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:39:01,043 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:39:01,050 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:39:01,052 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:39:01,052 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:39:44,603 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.011 minutes, events=16, succcessCount=8, totalEvents=20, totalSuccessCount=10 2018-05-02 05:39:44,792 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 2018-05-02 05:39:44,796 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525238558502 znode expired, triggering replicatorRemoved event 2018-05-02 05:39:44,796 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:39:45,257 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 05:39:45,258 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 05:39:45,266 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 05:39:45,315 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474.meta.1525239585266.meta 2018-05-02 05:39:45,315 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 05:39:45,319 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-02 05:39:45,320 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AuthenticationService 2018-05-02 05:39:45,320 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:39:45,320 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=SecureBulkLoadService 2018-05-02 05:39:45,320 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:39:45,320 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:39:45,320 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:39:45,321 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2018-05-02 05:39:45,321 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:39:45,321 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:39:45,323 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-02 05:39:45,328 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-02 05:39:45,329 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 05:39:45,329 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-02 05:39:45,329 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated hbase:meta,,1.1588230740 2018-05-02 05:39:45,346 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 05:39:45,347 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 05:39:45,348 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:39:45,349 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:39:45,404 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/719732a22ccb4e58aef5e4ab7c3fb0ba 2018-05-02 05:39:45,435 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/ba1eb1029b494bc3812c1db310fffa4e 2018-05-02 05:39:45,436 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:39:45,446 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 05:39:45,446 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 05:39:45,447 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:39:45,448 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:39:45,488 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/00f6c58a4ce94421b57455b1c3162100 2018-05-02 05:39:45,513 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/8b64c97177a74d56bbb40fc595fa8fb4 2018-05-02 05:39:45,514 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:39:45,523 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740 2018-05-02 05:39:45,546 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0M)) instead. 2018-05-02 05:39:45,583 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/800.seqid, newMaxSeqId=800, maxSeqId=799 2018-05-02 05:39:45,589 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=800 2018-05-02 05:39:45,593 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 05:39:45,598 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-02 05:39:45,598 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened hbase:meta,,1.1588230740 on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:39:45,668 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:39:45,670 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:39:45,670 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:39:45,675 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:39:45,677 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:39:45,677 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:39:45,678 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:39:45,678 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 05:39:45,679 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:39:46,275 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:39:46,289 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:39:46,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 05:39:46,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 05:39:46,291 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:39:46,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 05:39:46,291 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:39:46,291 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:39:46,291 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:39:46,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 05:39:46,291 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:39:46,291 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:39:46,292 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 05:39:46,292 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:39:46,292 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:46,302 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:39:46,303 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:39:46,304 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opening region: {ENCODED => 94f6ca283dbb4445b2bcdc321b734d28, NAME => 'test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 05:39:46,304 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opening region: {ENCODED => e75a388bc2011feed75bdc1a0e99a9a9, NAME => 'test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 05:39:46,305 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AuthenticationService 2018-05-02 05:39:46,305 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:39:46,306 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=SecureBulkLoadService 2018-05-02 05:39:46,306 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:39:46,306 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:39:46,308 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AuthenticationService 2018-05-02 05:39:46,309 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:39:46,307 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:39:46,309 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 05:39:46,309 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AccessControlService 2018-05-02 05:39:46,309 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:39:46,309 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:39:46,309 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:39:46,310 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=SecureBulkLoadService 2018-05-02 05:39:46,311 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 05:39:46,311 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:39:46,311 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:39:46,311 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:39:46,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. service=AccessControlService 2018-05-02 05:39:46,312 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:39:46,312 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:39:46,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 05:39:46,312 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:39:46,314 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:46,314 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 05:39:46,315 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:39:46,315 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:46,316 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:39:46,316 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 05:39:46,316 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:39:46,316 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 05:39:46,317 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:39:46,317 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:39:46,318 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:39:46,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 05:39:46,319 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:39:46,319 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:39:46,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:39:46,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:39:46,319 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:39:46,317 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:39:46,343 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:39:46,343 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 05:39:46,344 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:39:46,346 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:39:46,346 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 05:39:46,346 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf 2018-05-02 05:39:46,346 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 05:39:46,346 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 05:39:46,347 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:39:46,347 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:39:46,352 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:39:46,352 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:39:46,383 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 05:39:46,384 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:39:46,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 05:39:46,405 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 05:39:46,406 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:39:46,410 DEBUG [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/test_cf/6120c78c262141868de3a5506d72ea0b 2018-05-02 05:39:46,410 INFO [StoreOpener-e75a388bc2011feed75bdc1a0e99a9a9-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:39:46,441 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 05:39:46,462 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf/e1e7eacb3d0945eabdc05f9612dcf1a3 2018-05-02 05:39:46,462 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:39:46,466 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9 2018-05-02 05:39:46,497 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12150.seqid, newMaxSeqId=12150, maxSeqId=12149 2018-05-02 05:39:46,499 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 05:39:46,506 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12150 2018-05-02 05:39:46,523 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:39:46,527 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:39:46,527 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:39:46,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12068.seqid, newMaxSeqId=12068, maxSeqId=12067 2018-05-02 05:39:46,539 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/e75a388bc2011feed75bdc1a0e99a9a9/recovered.edits/12841.seqid, newMaxSeqId=12841, maxSeqId=12840 2018-05-02 05:39:46,552 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=12068 2018-05-02 05:39:46,556 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opened e75a388bc2011feed75bdc1a0e99a9a9; next sequenceid=12841 2018-05-02 05:39:46,557 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:39:46,561 INFO [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:39:46,562 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:39:46,562 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:39:46,564 DEBUG [PostOpenDeployTasks:e75a388bc2011feed75bdc1a0e99a9a9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:39:46,565 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:39:46,565 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13401.seqid, newMaxSeqId=13401, maxSeqId=13400 2018-05-02 05:39:46,574 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opened 94f6ca283dbb4445b2bcdc321b734d28; next sequenceid=13401 2018-05-02 05:39:46,577 INFO [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:39:46,581 DEBUG [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:39:46,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:39:48,192 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 05:39:48,193 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-02 05:39:50,329 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:39:50,331 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:39:50,334 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:39:50,604 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:30.012 minutes, events=10, succcessCount=10, totalEvents=10, totalSuccessCount=10 2018-05-02 05:39:50,839 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:39:51,192 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:39:51,192 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:39:51,256 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:39:51,256 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:39:51,256 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:39:51,262 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:39:51,264 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:39:51,264 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:39:51,396 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 05:40:18,531 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:40:40,279 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=156.66 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=2, accesses=24, hits=11, hitRatio=45.83%, , cachingAccesses=24, cachingHits=11, cachingHitsRatio=45.83%, evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 05:40:44,606 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=4, succcessCount=2, totalEvents=24, totalSuccessCount=12 2018-05-02 05:40:52,237 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=1, reused chunk count=0, reuseRatio=0.00% 2018-05-02 05:40:52,238 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 05:41:12,098 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:41:12,099 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 05:41:12,101 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 05:41:12,102 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 05:41:12,102 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:41:12,104 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 05:41:12,107 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 05:41:12,108 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 05:41:12,108 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 05:41:12,108 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 05:41:12,108 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 05:41:12,108 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/4 2018-05-02 05:41:12,108 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 05:41:12,113 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 2018-05-02 05:41:12,116 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525238658606 znode expired, triggering replicatorRemoved event 2018-05-02 05:41:12,116 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:41:12,544 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:41:14,055 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:41:14,055 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => 3bbeffd33dfc99ea8862c8eae819df62, NAME => 'test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 05:41:14,055 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 59a7b13a4cf2cd2376c378f77087088d, NAME => 'test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 05:41:14,056 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AuthenticationService 2018-05-02 05:41:14,056 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AuthenticationService 2018-05-02 05:41:14,056 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:41:14,056 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:41:14,056 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=SecureBulkLoadService 2018-05-02 05:41:14,056 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=SecureBulkLoadService 2018-05-02 05:41:14,056 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:41:14,056 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:41:14,056 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:41:14,057 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:41:14,056 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:41:14,057 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:41:14,057 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AccessControlService 2018-05-02 05:41:14,057 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AccessControlService 2018-05-02 05:41:14,057 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:41:14,057 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:41:14,058 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:41:14,058 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 59a7b13a4cf2cd2376c378f77087088d 2018-05-02 05:41:14,058 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:41:14,058 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:14,057 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:41:14,059 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 05:41:14,059 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:41:14,059 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:14,064 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:41:14,065 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => 931a5308337d39ab8fcac37d3a5e5844, NAME => 'test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 05:41:14,065 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AuthenticationService 2018-05-02 05:41:14,066 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:41:14,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=SecureBulkLoadService 2018-05-02 05:41:14,066 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:41:14,066 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:41:14,066 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:41:14,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AccessControlService 2018-05-02 05:41:14,066 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:41:14,066 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:41:14,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 931a5308337d39ab8fcac37d3a5e5844 2018-05-02 05:41:14,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:41:14,067 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:14,088 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 05:41:14,089 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 05:41:14,090 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:14,091 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:41:14,105 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 05:41:14,105 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 05:41:14,107 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:14,107 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:41:14,120 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 05:41:14,120 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 05:41:14,122 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:14,122 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:41:14,198 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf/081e4f87bb6141d5bac9d82300027aa3 2018-05-02 05:41:14,198 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:41:14,205 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf/51d1fafd7fd44303b7556cecfd380615 2018-05-02 05:41:14,206 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:41:14,213 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf/8b3b68c170174446a4896b3d11e3b7ac 2018-05-02 05:41:14,213 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:41:14,214 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 05:41:14,224 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d 2018-05-02 05:41:14,229 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844 2018-05-02 05:41:14,233 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:41:14,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => 2859fac3bc772763b3fd1621c2669f2b, NAME => 'test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 05:41:14,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AuthenticationService 2018-05-02 05:41:14,257 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 05:41:14,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=SecureBulkLoadService 2018-05-02 05:41:14,257 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 05:41:14,257 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 05:41:14,257 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 05:41:14,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. service=AccessControlService 2018-05-02 05:41:14,258 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 05:41:14,258 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 05:41:14,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2859fac3bc772763b3fd1621c2669f2b 2018-05-02 05:41:14,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:41:14,258 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:41:14,308 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12424.seqid, newMaxSeqId=12424, maxSeqId=12423 2018-05-02 05:41:14,313 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 05:41:14,313 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf 2018-05-02 05:41:14,314 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=2, currentSize=156.66 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.66 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 05:41:14,315 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 05:41:14,318 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 59a7b13a4cf2cd2376c378f77087088d; next sequenceid=12424 2018-05-02 05:41:14,326 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12452.seqid, newMaxSeqId=12452, maxSeqId=12451 2018-05-02 05:41:14,334 INFO [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:41:14,338 DEBUG [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:41:14,338 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:41:14,339 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened 931a5308337d39ab8fcac37d3a5e5844; next sequenceid=12452 2018-05-02 05:41:14,347 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12455.seqid, newMaxSeqId=12455, maxSeqId=12454 2018-05-02 05:41:14,362 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 3bbeffd33dfc99ea8862c8eae819df62; next sequenceid=12455 2018-05-02 05:41:14,367 INFO [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:41:14,375 DEBUG [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:41:14,375 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:41:14,375 INFO [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:41:14,383 DEBUG [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:41:14,383 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:41:14,421 DEBUG [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/test_cf/a0c5ddf407ab4960b0c246592b2cd164 2018-05-02 05:41:14,421 INFO [StoreOpener-2859fac3bc772763b3fd1621c2669f2b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 05:41:14,435 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b 2018-05-02 05:41:14,503 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2859fac3bc772763b3fd1621c2669f2b/recovered.edits/12710.seqid, newMaxSeqId=12710, maxSeqId=12709 2018-05-02 05:41:14,509 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened 2859fac3bc772763b3fd1621c2669f2b; next sequenceid=12710 2018-05-02 05:41:14,528 INFO [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:41:14,532 DEBUG [PostOpenDeployTasks:2859fac3bc772763b3fd1621c2669f2b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:41:14,532 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:41:17,606 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:27.003 minutes, events=2, succcessCount=2, totalEvents=12, totalSuccessCount=12 2018-05-02 05:41:19,058 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:41:19,059 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:41:19,063 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:41:19,571 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:41:20,112 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:41:20,113 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:41:20,271 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:41:20,271 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:41:20,271 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:41:20,287 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:41:20,293 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:41:20,293 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:41:44,609 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.004 minutes, events=4, succcessCount=2, totalEvents=28, totalSuccessCount=14 2018-05-02 05:41:52,275 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:43:21,061 DEBUG [RS-EventLoopGroup-1-5] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:43:22,127 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:43:24,068 DEBUG [RS-EventLoopGroup-1-6] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 05:43:24,068 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:24,125 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 05:43:24,126 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 05:43:24,133 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 05:43:24,637 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 05:43:25,046 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 05:43:25,047 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 05:43:25,074 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:25,153 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 05:43:25,153 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 05:43:25,153 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 05:43:25,162 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 05:43:25,166 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 05:43:25,166 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 05:43:26,082 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:27,087 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 05:43:27,314 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 05:43:30,492 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 05:43:30,492 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:43:30,492 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 05:43:30,494 DEBUG [RS-EventLoopGroup-1-7] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:43:30,498 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 05:43:30,524 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 05:43:30,524 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 05:43:30,533 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 05:43:30,534 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 05:43:30,534 DEBUG [RS-EventLoopGroup-1-7] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 05:44:06,289 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:44:06,290 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:44:06,291 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:06,293 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:44:06,300 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:06,300 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:44:06,309 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:06,309 DEBUG [RS-EventLoopGroup-1-8] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:44:06,309 DEBUG [RS-EventLoopGroup-1-8] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:44:06,350 WARN [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Received OPEN for the region:hbase:meta,,1.1588230740, which is already online 2018-05-02 05:44:07,198 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 05:44:07,200 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 05:44:07,200 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:07,202 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 05:44:07,213 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:07,213 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 05:44:07,218 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 05:44:07,219 DEBUG [RS-EventLoopGroup-1-9] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 05:44:07,219 DEBUG [RS-EventLoopGroup-1-9] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 05:44:10,052 ERROR [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ***** ABORTING region server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474: org.apache.hadoop.hbase.YouAreDeadException: rit=OPEN, location=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, table=test_hbase_ha_load_test_tool_hbase, region=94f6ca283dbb4445b2bcdc321b734d28reported OPEN on server=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 but state has otherwise. at org.apache.hadoop.hbase.master.assignment.AssignmentManager.checkOnlineRegionsReport(AssignmentManager.java:1065) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.reportOnlineRegions(AssignmentManager.java:987) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerReport(MasterRpcServices.java:459) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:13118) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304) Caused by: org.apache.hadoop.hbase.exceptions.UnexpectedStateException: rit=OPEN, location=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, table=test_hbase_ha_load_test_tool_hbase, region=94f6ca283dbb4445b2bcdc321b734d28reported OPEN on server=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 but state has otherwise. at org.apache.hadoop.hbase.master.assignment.AssignmentManager.checkOnlineRegionsReport(AssignmentManager.java:1037) ... 7 more ***** org.apache.hadoop.hbase.YouAreDeadException: org.apache.hadoop.hbase.YouAreDeadException: rit=OPEN, location=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, table=test_hbase_ha_load_test_tool_hbase, region=94f6ca283dbb4445b2bcdc321b734d28reported OPEN on server=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 but state has otherwise. at org.apache.hadoop.hbase.master.assignment.AssignmentManager.checkOnlineRegionsReport(AssignmentManager.java:1065) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.reportOnlineRegions(AssignmentManager.java:987) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerReport(MasterRpcServices.java:459) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:13118) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304) Caused by: org.apache.hadoop.hbase.exceptions.UnexpectedStateException: rit=OPEN, location=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, table=test_hbase_ha_load_test_tool_hbase, region=94f6ca283dbb4445b2bcdc321b734d28reported OPEN on server=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 but state has otherwise. at org.apache.hadoop.hbase.master.assignment.AssignmentManager.checkOnlineRegionsReport(AssignmentManager.java:1037) ... 7 more at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:100) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:90) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:358) at org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:335) at org.apache.hadoop.hbase.regionserver.HRegionServer.tryRegionServerReport(HRegionServer.java:1183) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:992) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.YouAreDeadException): org.apache.hadoop.hbase.YouAreDeadException: rit=OPEN, location=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, table=test_hbase_ha_load_test_tool_hbase, region=94f6ca283dbb4445b2bcdc321b734d28reported OPEN on server=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 but state has otherwise. at org.apache.hadoop.hbase.master.assignment.AssignmentManager.checkOnlineRegionsReport(AssignmentManager.java:1065) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.reportOnlineRegions(AssignmentManager.java:987) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerReport(MasterRpcServices.java:459) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:13118) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304) Caused by: org.apache.hadoop.hbase.exceptions.UnexpectedStateException: rit=OPEN, location=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, table=test_hbase_ha_load_test_tool_hbase, region=94f6ca283dbb4445b2bcdc321b734d28reported OPEN on server=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 but state has otherwise. at org.apache.hadoop.hbase.master.assignment.AssignmentManager.checkOnlineRegionsReport(AssignmentManager.java:1037) ... 7 more at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:387) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:95) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:410) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:406) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:103) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:118) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:161) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:191) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:310) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:284) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) at org.apache.hadoop.hbase.security.SaslUnwrapHandler.channelRead0(SaslUnwrapHandler.java:52) at org.apache.hadoop.hbase.security.SaslUnwrapHandler.channelRead0(SaslUnwrapHandler.java:33) at org.apache.hbase.thirdparty.io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:310) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:284) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1359) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:935) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:801) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:404) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:304) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:138) ... 1 more 2018-05-02 05:44:10,053 ERROR [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: RegionServer abort: loaded coprocessors are: [org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor, org.apache.hadoop.hbase.security.token.TokenProvider, org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint, org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint] 2018-05-02 05:44:10,069 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Dump of metrics as JSON on abort: { "beans" : [ { "name" : "java.lang:type=Memory", "modelerType" : "sun.management.MemoryImpl", "Verbose" : true, "ObjectPendingFinalizationCount" : 0, "NonHeapMemoryUsage" : { "committed" : 125829120, "init" : 2555904, "max" : -1, "used" : 123185280 }, "HeapMemoryUsage" : { "committed" : 2147483648, "init" : 2147483648, "max" : 2147483648, "used" : 494357560 }, "ObjectName" : "java.lang:type=Memory" } ], "beans" : [ { "name" : "Hadoop:service=HBase,name=RegionServer,sub=IPC", "modelerType" : "RegionServer,sub=IPC", "tag.Context" : "regionserver", "tag.Hostname" : "ctr-e138-1518143905142-279227-01-000002.hwx.site", "queueSize" : 0, "numCallsInGeneralQueue" : 0, "numCallsInReplicationQueue" : 0, "numCallsInPriorityQueue" : 0, "numOpenConnections" : 1, "numActiveHandler" : 0, "numGeneralCallsDropped" : 0, "numLifoModeSwitches" : 0, "numCallsInWriteQueue" : 0, "numCallsInReadQueue" : 0, "numCallsInScanQueue" : 0, "numActiveWriteHandler" : 0, "numActiveReadHandler" : 0, "numActiveScanHandler" : 0, "receivedBytes" : 80276, "exceptions.RegionMovedException" : 0, "exceptions.multiResponseTooLarge" : 0, "authenticationSuccesses" : 4, "authorizationFailures" : 0, "TotalCallTime_num_ops" : 122, "TotalCallTime_min" : 0, "TotalCallTime_max" : 206, "TotalCallTime_mean" : 20, "TotalCallTime_25th_percentile" : 2, "TotalCallTime_median" : 2, "TotalCallTime_75th_percentile" : 24, "TotalCallTime_90th_percentile" : 39, "TotalCallTime_95th_percentile" : 206, "TotalCallTime_98th_percentile" : 206, "TotalCallTime_99th_percentile" : 206, "TotalCallTime_99.9th_percentile" : 206, "TotalCallTime_TimeRangeCount_0-1" : 2, "TotalCallTime_TimeRangeCount_1-3" : 9, "TotalCallTime_TimeRangeCount_3-10" : 1, "TotalCallTime_TimeRangeCount_10-30" : 3, "TotalCallTime_TimeRangeCount_30-100" : 1, "TotalCallTime_TimeRangeCount_100-300" : 1, "TotalCallTime_TimeRangeCount_600000-inf" : 105, "exceptions.RegionTooBusyException" : 0, "exceptions.FailedSanityCheckException" : 0, "ResponseSize_num_ops" : 122, "ResponseSize_min" : 2, "ResponseSize_max" : 53508, "ResponseSize_mean" : 6403, "ResponseSize_25th_percentile" : 51, "ResponseSize_median" : 57, "ResponseSize_75th_percentile" : 79, "ResponseSize_90th_percentile" : 30875, "ResponseSize_95th_percentile" : 42191, "ResponseSize_98th_percentile" : 48981, "ResponseSize_99th_percentile" : 51244, "ResponseSize_99.9th_percentile" : 53281, "ResponseSize_SizeRangeCount_0-10" : 3, "ResponseSize_SizeRangeCount_10-100" : 10, "ResponseSize_SizeRangeCount_100-1000" : 4, "ResponseSize_SizeRangeCount_100000000-inf" : 105, "exceptions.UnknownScannerException" : 0, "exceptions.OutOfOrderScannerNextException" : 0, "exceptions" : 0, "ProcessCallTime_num_ops" : 122, "ProcessCallTime_min" : 0, "ProcessCallTime_max" : 206, "ProcessCallTime_mean" : 20, "ProcessCallTime_25th_percentile" : 1, "ProcessCallTime_median" : 2, "ProcessCallTime_75th_percentile" : 24, "ProcessCallTime_90th_percentile" : 39, "ProcessCallTime_95th_percentile" : 206, "ProcessCallTime_98th_percentile" : 206, "ProcessCallTime_99th_percentile" : 206, "ProcessCallTime_99.9th_percentile" : 206, "ProcessCallTime_TimeRangeCount_0-1" : 5, "ProcessCallTime_TimeRangeCount_1-3" : 6, "ProcessCallTime_TimeRangeCount_3-10" : 1, "ProcessCallTime_TimeRangeCount_10-30" : 3, "ProcessCallTime_TimeRangeCount_30-100" : 1, "ProcessCallTime_TimeRangeCount_100-300" : 1, "ProcessCallTime_TimeRangeCount_600000-inf" : 105, "authenticationFallbacks" : 0, "exceptions.NotServingRegionException" : 0, "exceptions.callQueueTooBig" : 0, "authorizationSuccesses" : 4, "exceptions.ScannerResetException" : 0, "RequestSize_num_ops" : 122, "RequestSize_min" : 78, "RequestSize_max" : 432, "RequestSize_mean" : 133, "RequestSize_25th_percentile" : 90, "RequestSize_median" : 93, "RequestSize_75th_percentile" : 109, "RequestSize_90th_percentile" : 282, "RequestSize_95th_percentile" : 357, "RequestSize_98th_percentile" : 402, "RequestSize_99th_percentile" : 417, "RequestSize_99.9th_percentile" : 430, "RequestSize_SizeRangeCount_10-100" : 11, "RequestSize_SizeRangeCount_100-1000" : 6, "RequestSize_SizeRangeCount_100000000-inf" : 105, "sentBytes" : 121034, "QueueCallTime_num_ops" : 122, "QueueCallTime_min" : 0, "QueueCallTime_max" : 1, "QueueCallTime_mean" : 0, "QueueCallTime_25th_percentile" : 0, "QueueCallTime_median" : 0, "QueueCallTime_75th_percentile" : 0, "QueueCallTime_90th_percentile" : 1, "QueueCallTime_95th_percentile" : 1, "QueueCallTime_98th_percentile" : 1, "QueueCallTime_99th_percentile" : 1, "QueueCallTime_99.9th_percentile" : 1, "QueueCallTime_TimeRangeCount_0-1" : 17, "QueueCallTime_TimeRangeCount_600000-inf" : 105, "authenticationFailures" : 0 } ], "beans" : [ { "name" : "Hadoop:service=HBase,name=RegionServer,sub=Replication", "modelerType" : "RegionServer,sub=Replication", "tag.Context" : "regionserver", "tag.Hostname" : "ctr-e138-1518143905142-279227-01-000002.hwx.site", "sink.appliedHFiles" : 0, "sink.appliedOps" : 0, "Sink.ageOfLastAppliedOp_num_ops" : 0, "Sink.ageOfLastAppliedOp_min" : 0, "Sink.ageOfLastAppliedOp_max" : 0, "Sink.ageOfLastAppliedOp_mean" : 0, "Sink.ageOfLastAppliedOp_25th_percentile" : 0, "Sink.ageOfLastAppliedOp_median" : 0, "Sink.ageOfLastAppliedOp_75th_percentile" : 0, "Sink.ageOfLastAppliedOp_90th_percentile" : 0, "Sink.ageOfLastAppliedOp_95th_percentile" : 0, "Sink.ageOfLastAppliedOp_98th_percentile" : 0, "Sink.ageOfLastAppliedOp_99th_percentile" : 0, "Sink.ageOfLastAppliedOp_99.9th_percentile" : 0, "sink.appliedBatches" : 0 } ], "beans" : [ { "name" : "Hadoop:service=HBase,name=RegionServer,sub=Server", "modelerType" : "RegionServer,sub=Server", "tag.zookeeperQuorum" : "ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181", "tag.serverName" : "ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474", "tag.clusterId" : "1b48ec3a-bf8b-4867-bad7-52eb7796791c", "tag.Context" : "regionserver", "tag.Hostname" : "ctr-e138-1518143905142-279227-01-000002.hwx.site", "regionCount" : 22, "storeCount" : 23, "hlogFileCount" : 2, "hlogFileSize" : 0, "storeFileCount" : 25, "memStoreSize" : 38437, "storeFileSize" : 45128122, "maxStoreFileAge" : 1700415, "minStoreFileAge" : 175047, "avgStoreFileAge" : 820063, "numReferenceFiles" : 0, "regionServerStartTime" : 1525239334474, "averageRegionSize" : 2053025, "totalRequestCount" : 124, "totalRowActionRequestCount" : 90, "readRequestCount" : 30, "filteredReadRequestCount" : 0, "writeRequestCount" : 60, "rpcGetRequestCount" : 40, "rpcScanRequestCount" : 4, "rpcMultiRequestCount" : 0, "rpcMutateRequestCount" : 62, "checkMutateFailedCount" : 0, "checkMutatePassedCount" : 0, "storeFileIndexSize" : 102104, "staticIndexSize" : 50738, "staticBloomSize" : 688128, "mutationsWithoutWALCount" : 0, "mutationsWithoutWALSize" : 0, "percentFilesLocal" : 66.57892608642578, "percentFilesLocalSecondaryRegions" : 0.0, "splitQueueLength" : 0, "compactionQueueLength" : 0, "smallCompactionQueueLength" : 0, "largeCompactionQueueLength" : 0, "flushQueueLength" : 0, "blockCacheFreeSize" : 214347544, "blockCacheCount" : 30, "blockCacheSize" : 400824, "blockCacheHitCount" : 73, "blockCacheHitCountPrimary" : 73, "blockCacheMissCount" : 41, "blockCacheMissCountPrimary" : 41, "blockCacheEvictionCount" : 0, "blockCacheEvictionCountPrimary" : 0, "blockCacheCountHitPercent" : 64.03508771929825, "blockCacheExpressHitPercent" : 64.03508771929825, "blockCacheFailedInsertionCount" : 0, "blockCacheDataMissCount" : 26, "blockCacheLeafIndexMissCount" : 0, "blockCacheBloomChunkMissCount" : 0, "blockCacheMetaMissCount" : 0, "blockCacheRootIndexMissCount" : 0, "blockCacheIntermediateIndexMissCount" : 0, "blockCacheFileInfoMissCount" : 0, "blockCacheGeneralBloomMetaMissCount" : 0, "blockCacheDeleteFamilyBloomMissCount" : 0, "blockCacheTrailerMissCount" : 0, "blockCacheDataHitCount" : 57, "blockCacheLeafIndexHitCount" : 0, "blockCacheBloomChunkHitCount" : 0, "blockCacheMetaHitCount" : 0, "blockCacheRootIndexHitCount" : 0, "blockCacheIntermediateIndexHitCount" : 0, "blockCacheFileInfoHitCount" : 0, "blockCacheGeneralBloomMetaHitCount" : 0, "blockCacheDeleteFamilyBloomHitCount" : 0, "blockCacheTrailerHitCount" : 0, "l1CacheHitCount" : 73, "l1CacheMissCount" : 41, "l1CacheHitRatio" : 0.6403508771929824, "l1CacheMissRatio" : 0.35964912280701755, "l2CacheHitCount" : 0, "l2CacheMissCount" : 0, "l2CacheHitRatio" : 0.0, "l2CacheMissRatio" : 0.0, "updatesBlockedTime" : 0, "flushedCellsCount" : 0, "compactedCellsCount" : 0, "majorCompactedCellsCount" : 0, "flushedCellsSize" : 0, "compactedCellsSize" : 0, "majorCompactedCellsSize" : 0, "cellsCountCompactedFromMob" : 0, "cellsCountCompactedToMob" : 0, "cellsSizeCompactedFromMob" : 0, "cellsSizeCompactedToMob" : 0, "mobFlushCount" : 0, "mobFlushedCellsCount" : 0, "mobFlushedCellsSize" : 0, "mobScanCellsCount" : 0, "mobScanCellsSize" : 0, "mobFileCacheCount" : 0, "mobFileCacheAccessCount" : 0, "mobFileCacheMissCount" : 0, "mobFileCacheEvictedCount" : 0, "mobFileCacheHitPercent" : 0.0, "hedgedReads" : 0, "hedgedReadWins" : 0, "blockedRequestCount" : 0, "MajorCompactionTime_num_ops" : 0, "MajorCompactionTime_min" : 0, "MajorCompactionTime_max" : 0, "MajorCompactionTime_mean" : 0, "MajorCompactionTime_25th_percentile" : 0, "MajorCompactionTime_median" : 0, "MajorCompactionTime_75th_percentile" : 0, "MajorCompactionTime_90th_percentile" : 0, "MajorCompactionTime_95th_percentile" : 0, "MajorCompactionTime_98th_percentile" : 0, "MajorCompactionTime_99th_percentile" : 0, "MajorCompactionTime_99.9th_percentile" : 0, "PauseTimeWithGc_num_ops" : 0, "PauseTimeWithGc_min" : 0, "PauseTimeWithGc_max" : 0, "PauseTimeWithGc_mean" : 0, "PauseTimeWithGc_25th_percentile" : 0, "PauseTimeWithGc_median" : 0, "PauseTimeWithGc_75th_percentile" : 0, "PauseTimeWithGc_90th_percentile" : 0, "PauseTimeWithGc_95th_percentile" : 0, "PauseTimeWithGc_98th_percentile" : 0, "PauseTimeWithGc_99th_percentile" : 0, "PauseTimeWithGc_99.9th_percentile" : 0, "compactedOutputBytes" : 0, "pauseWarnThresholdExceeded" : 0, "ScanTime_num_ops" : 4, "ScanTime_min" : 3, "ScanTime_max" : 184, "ScanTime_mean" : 57, "ScanTime_25th_percentile" : 3, "ScanTime_median" : 4, "ScanTime_75th_percentile" : 39, "ScanTime_90th_percentile" : 184, "ScanTime_95th_percentile" : 184, "ScanTime_98th_percentile" : 184, "ScanTime_99th_percentile" : 184, "ScanTime_99.9th_percentile" : 184, "ScanTime_TimeRangeCount_1-3" : 2, "ScanTime_TimeRangeCount_30-100" : 1, "ScanTime_TimeRangeCount_100-300" : 1, "Increment_num_ops" : 0, "Increment_min" : 0, "Increment_max" : 0, "Increment_mean" : 0, "Increment_25th_percentile" : 0, "Increment_median" : 0, "Increment_75th_percentile" : 0, "Increment_90th_percentile" : 0, "Increment_95th_percentile" : 0, "Increment_98th_percentile" : 0, "Increment_99th_percentile" : 0, "Increment_99.9th_percentile" : 0, "Delete_num_ops" : 0, "Delete_min" : 0, "Delete_max" : 0, "Delete_mean" : 0, "Delete_25th_percentile" : 0, "Delete_median" : 0, "Delete_75th_percentile" : 0, "Delete_90th_percentile" : 0, "Delete_95th_percentile" : 0, "Delete_98th_percentile" : 0, "Delete_99th_percentile" : 0, "Delete_99.9th_percentile" : 0, "Put_num_ops" : 62, "Put_min" : 6, "Put_max" : 26, "Put_mean" : 16, "Put_25th_percentile" : 6, "Put_median" : 7, "Put_75th_percentile" : 26, "Put_90th_percentile" : 26, "Put_95th_percentile" : 26, "Put_98th_percentile" : 26, "Put_99th_percentile" : 26, "Put_99.9th_percentile" : 26, "Put_TimeRangeCount_3-10" : 1, "Put_TimeRangeCount_10-30" : 1, "Put_TimeRangeCount_600000-inf" : 60, "DeleteBatch_num_ops" : 0, "DeleteBatch_min" : 0, "DeleteBatch_max" : 0, "DeleteBatch_mean" : 0, "DeleteBatch_25th_percentile" : 0, "DeleteBatch_median" : 0, "DeleteBatch_75th_percentile" : 0, "DeleteBatch_90th_percentile" : 0, "DeleteBatch_95th_percentile" : 0, "DeleteBatch_98th_percentile" : 0, "DeleteBatch_99th_percentile" : 0, "DeleteBatch_99.9th_percentile" : 0, "splitRequestCount" : 0, "FlushMemstoreSize_num_ops" : 0, "FlushMemstoreSize_min" : 0, "FlushMemstoreSize_max" : 0, "FlushMemstoreSize_mean" : 0, "FlushMemstoreSize_25th_percentile" : 0, "FlushMemstoreSize_median" : 0, "FlushMemstoreSize_75th_percentile" : 0, "FlushMemstoreSize_90th_percentile" : 0, "FlushMemstoreSize_95th_percentile" : 0, "FlushMemstoreSize_98th_percentile" : 0, "FlushMemstoreSize_99th_percentile" : 0, "FlushMemstoreSize_99.9th_percentile" : 0, "CompactionInputFileCount_num_ops" : 0, "CompactionInputFileCount_min" : 0, "CompactionInputFileCount_max" : 0, "CompactionInputFileCount_mean" : 0, "CompactionInputFileCount_25th_percentile" : 0, "CompactionInputFileCount_median" : 0, "CompactionInputFileCount_75th_percentile" : 0, "CompactionInputFileCount_90th_percentile" : 0, "CompactionInputFileCount_95th_percentile" : 0, "CompactionInputFileCount_98th_percentile" : 0, "CompactionInputFileCount_99th_percentile" : 0, "CompactionInputFileCount_99.9th_percentile" : 0, "PutBatch_num_ops" : 0, "PutBatch_min" : 0, "PutBatch_max" : 0, "PutBatch_mean" : 0, "PutBatch_25th_percentile" : 0, "PutBatch_median" : 0, "PutBatch_75th_percentile" : 0, "PutBatch_90th_percentile" : 0, "PutBatch_95th_percentile" : 0, "PutBatch_98th_percentile" : 0, "PutBatch_99th_percentile" : 0, "PutBatch_99.9th_percentile" : 0, "CompactionTime_num_ops" : 0, "CompactionTime_min" : 0, "CompactionTime_max" : 0, "CompactionTime_mean" : 0, "CompactionTime_25th_percentile" : 0, "CompactionTime_median" : 0, "CompactionTime_75th_percentile" : 0, "CompactionTime_90th_percentile" : 0, "CompactionTime_95th_percentile" : 0, "CompactionTime_98th_percentile" : 0, "CompactionTime_99th_percentile" : 0, "CompactionTime_99.9th_percentile" : 0, "Get_num_ops" : 40, "Get_min" : 1, "Get_max" : 2, "Get_mean" : 1, "Get_25th_percentile" : 1, "Get_median" : 1, "Get_75th_percentile" : 2, "Get_90th_percentile" : 2, "Get_95th_percentile" : 2, "Get_98th_percentile" : 2, "Get_99th_percentile" : 2, "Get_99.9th_percentile" : 2, "Get_TimeRangeCount_0-1" : 6, "Get_TimeRangeCount_1-3" : 4, "Get_TimeRangeCount_600000-inf" : 30, "MajorCompactionInputFileCount_num_ops" : 0, "MajorCompactionInputFileCount_min" : 0, "MajorCompactionInputFileCount_max" : 0, "MajorCompactionInputFileCount_mean" : 0, "MajorCompactionInputFileCount_25th_percentile" : 0, "MajorCompactionInputFileCount_median" : 0, "MajorCompactionInputFileCount_75th_percentile" : 0, "MajorCompactionInputFileCount_90th_percentile" : 0, "MajorCompactionInputFileCount_95th_percentile" : 0, "MajorCompactionInputFileCount_98th_percentile" : 0, "MajorCompactionInputFileCount_99th_percentile" : 0, "MajorCompactionInputFileCount_99.9th_percentile" : 0, "CheckAndPut_num_ops" : 0, "CheckAndPut_min" : 0, "CheckAndPut_max" : 0, "CheckAndPut_mean" : 0, "CheckAndPut_25th_percentile" : 0, "CheckAndPut_median" : 0, "CheckAndPut_75th_percentile" : 0, "CheckAndPut_90th_percentile" : 0, "CheckAndPut_95th_percentile" : 0, "CheckAndPut_98th_percentile" : 0, "CheckAndPut_99th_percentile" : 0, "CheckAndPut_99.9th_percentile" : 0, "SplitTime_num_ops" : 0, "SplitTime_min" : 0, "SplitTime_max" : 0, "SplitTime_mean" : 0, "SplitTime_25th_percentile" : 0, "SplitTime_median" : 0, "SplitTime_75th_percentile" : 0, "SplitTime_90th_percentile" : 0, "SplitTime_95th_percentile" : 0, "SplitTime_98th_percentile" : 0, "SplitTime_99th_percentile" : 0, "SplitTime_99.9th_percentile" : 0, "MajorCompactionOutputSize_num_ops" : 0, "MajorCompactionOutputSize_min" : 0, "MajorCompactionOutputSize_max" : 0, "MajorCompactionOutputSize_mean" : 0, "MajorCompactionOutputSize_25th_percentile" : 0, "MajorCompactionOutputSize_median" : 0, "MajorCompactionOutputSize_75th_percentile" : 0, "MajorCompactionOutputSize_90th_percentile" : 0, "MajorCompactionOutputSize_95th_percentile" : 0, "MajorCompactionOutputSize_98th_percentile" : 0, "MajorCompactionOutputSize_99th_percentile" : 0, "MajorCompactionOutputSize_99.9th_percentile" : 0, "majorCompactedInputBytes" : 0, "slowAppendCount" : 0, "flushedOutputBytes" : 0, "CompactionOutputFileCount_num_ops" : 0, "CompactionOutputFileCount_min" : 0, "CompactionOutputFileCount_max" : 0, "CompactionOutputFileCount_mean" : 0, "CompactionOutputFileCount_25th_percentile" : 0, "CompactionOutputFileCount_median" : 0, "CompactionOutputFileCount_75th_percentile" : 0, "CompactionOutputFileCount_90th_percentile" : 0, "CompactionOutputFileCount_95th_percentile" : 0, "CompactionOutputFileCount_98th_percentile" : 0, "CompactionOutputFileCount_99th_percentile" : 0, "CompactionOutputFileCount_99.9th_percentile" : 0, "slowDeleteCount" : 0, "Replay_num_ops" : 0, "Replay_min" : 0, "Replay_max" : 0, "Replay_mean" : 0, "Replay_25th_percentile" : 0, "Replay_median" : 0, "Replay_75th_percentile" : 0, "Replay_90th_percentile" : 0, "Replay_95th_percentile" : 0, "Replay_98th_percentile" : 0, "Replay_99th_percentile" : 0, "Replay_99.9th_percentile" : 0, "FlushTime_num_ops" : 0, "FlushTime_min" : 0, "FlushTime_max" : 0, "FlushTime_mean" : 0, "FlushTime_25th_percentile" : 0, "FlushTime_median" : 0, "FlushTime_75th_percentile" : 0, "FlushTime_90th_percentile" : 0, "FlushTime_95th_percentile" : 0, "FlushTime_98th_percentile" : 0, "FlushTime_99th_percentile" : 0, "FlushTime_99.9th_percentile" : 0, "MajorCompactionInputSize_num_ops" : 0, "MajorCompactionInputSize_min" : 0, "MajorCompactionInputSize_max" : 0, "MajorCompactionInputSize_mean" : 0, "MajorCompactionInputSize_25th_percentile" : 0, "MajorCompactionInputSize_median" : 0, "MajorCompactionInputSize_75th_percentile" : 0, "MajorCompactionInputSize_90th_percentile" : 0, "MajorCompactionInputSize_95th_percentile" : 0, "MajorCompactionInputSize_98th_percentile" : 0, "MajorCompactionInputSize_99th_percentile" : 0, "MajorCompactionInputSize_99.9th_percentile" : 0, "pauseInfoThresholdExceeded" : 0, "splitSuccessCount" : 0, "CheckAndDelete_num_ops" : 0, "CheckAndDelete_min" : 0, "CheckAndDelete_max" : 0, "CheckAndDelete_mean" : 0, "CheckAndDelete_25th_percentile" : 0, "CheckAndDelete_median" : 0, "CheckAndDelete_75th_percentile" : 0, "CheckAndDelete_90th_percentile" : 0, "CheckAndDelete_95th_percentile" : 0, "CheckAndDelete_98th_percentile" : 0, "CheckAndDelete_99th_percentile" : 0, "CheckAndDelete_99.9th_percentile" : 0, "CompactionInputSize_num_ops" : 0, "CompactionInputSize_min" : 0, "CompactionInputSize_max" : 0, "CompactionInputSize_mean" : 0, "CompactionInputSize_25th_percentile" : 0, "CompactionInputSize_median" : 0, "CompactionInputSize_75th_percentile" : 0, "CompactionInputSize_90th_percentile" : 0, "CompactionInputSize_95th_percentile" : 0, "CompactionInputSize_98th_percentile" : 0, "CompactionInputSize_99th_percentile" : 0, "CompactionInputSize_99.9th_percentile" : 0, "MajorCompactionOutputFileCount_num_ops" : 0, "MajorCompactionOutputFileCount_min" : 0, "MajorCompactionOutputFileCount_max" : 0, "MajorCompactionOutputFileCount_mean" : 0, "MajorCompactionOutputFileCount_25th_percentile" : 0, "MajorCompactionOutputFileCount_median" : 0, "MajorCompactionOutputFileCount_75th_percentile" : 0, "MajorCompactionOutputFileCount_90th_percentile" : 0, "MajorCompactionOutputFileCount_95th_percentile" : 0, "MajorCompactionOutputFileCount_98th_percentile" : 0, "MajorCompactionOutputFileCount_99th_percentile" : 0, "MajorCompactionOutputFileCount_99.9th_percentile" : 0, "ScanSize_num_ops" : 4, "ScanSize_min" : 347, "ScanSize_max" : 53269, "ScanSize_mean" : 26918, "ScanSize_25th_percentile" : 13577, "ScanSize_median" : 26808, "ScanSize_75th_percentile" : 40038, "ScanSize_90th_percentile" : 47976, "ScanSize_95th_percentile" : 50622, "ScanSize_98th_percentile" : 52210, "ScanSize_99th_percentile" : 52739, "ScanSize_99.9th_percentile" : 53216, "ScanSize_SizeRangeCount_100-1000" : 4, "slowGetCount" : 0, "flushedMemstoreBytes" : 0, "CompactionOutputSize_num_ops" : 0, "CompactionOutputSize_min" : 0, "CompactionOutputSize_max" : 0, "CompactionOutputSize_mean" : 0, "CompactionOutputSize_25th_percentile" : 0, "CompactionOutputSize_median" : 0, "CompactionOutputSize_75th_percentile" : 0, "CompactionOutputSize_90th_percentile" : 0, "CompactionOutputSize_95th_percentile" : 0, "CompactionOutputSize_98th_percentile" : 0, "CompactionOutputSize_99th_percentile" : 0, "CompactionOutputSize_99.9th_percentile" : 0, "majorCompactedOutputBytes" : 0, "PauseTimeWithoutGc_num_ops" : 0, "PauseTimeWithoutGc_min" : 0, "PauseTimeWithoutGc_max" : 0, "PauseTimeWithoutGc_mean" : 0, "PauseTimeWithoutGc_25th_percentile" : 0, "PauseTimeWithoutGc_median" : 0, "PauseTimeWithoutGc_75th_percentile" : 0, "PauseTimeWithoutGc_90th_percentile" : 0, "PauseTimeWithoutGc_95th_percentile" : 0, "PauseTimeWithoutGc_98th_percentile" : 0, "PauseTimeWithoutGc_99th_percentile" : 0, "PauseTimeWithoutGc_99.9th_percentile" : 0, "slowPutCount" : 0, "slowIncrementCount" : 0, "compactedInputBytes" : 0, "Append_num_ops" : 0, "Append_min" : 0, "Append_max" : 0, "Append_mean" : 0, "Append_25th_percentile" : 0, "Append_median" : 0, "Append_75th_percentile" : 0, "Append_90th_percentile" : 0, "Append_95th_percentile" : 0, "Append_98th_percentile" : 0, "Append_99th_percentile" : 0, "Append_99.9th_percentile" : 0, "FlushOutputSize_num_ops" : 0, "FlushOutputSize_min" : 0, "FlushOutputSize_max" : 0, "FlushOutputSize_mean" : 0, "FlushOutputSize_25th_percentile" : 0, "FlushOutputSize_median" : 0, "FlushOutputSize_75th_percentile" : 0, "FlushOutputSize_90th_percentile" : 0, "FlushOutputSize_95th_percentile" : 0, "FlushOutputSize_98th_percentile" : 0, "FlushOutputSize_99th_percentile" : 0, "FlushOutputSize_99.9th_percentile" : 0, "Bulkload_count" : 0, "Bulkload_mean_rate" : 0.0, "Bulkload_1min_rate" : 0.0, "Bulkload_5min_rate" : 0.0, "Bulkload_15min_rate" : 0.0, "Bulkload_num_ops" : 0, "Bulkload_min" : 0, "Bulkload_max" : 0, "Bulkload_mean" : 0, "Bulkload_25th_percentile" : 0, "Bulkload_median" : 0, "Bulkload_75th_percentile" : 0, "Bulkload_90th_percentile" : 0, "Bulkload_95th_percentile" : 0, "Bulkload_98th_percentile" : 0, "Bulkload_99th_percentile" : 0, "Bulkload_99.9th_percentile" : 0 } ] } 2018-05-02 05:44:10,092 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 05:44:10,094 DEBUG [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] coordination.ZkSplitLogWorkerCoordination: Current region server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-02 05:44:10,103 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474' ***** 2018-05-02 05:44:10,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,104 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: STOPPED: org.apache.hadoop.hbase.YouAreDeadException: rit=OPEN, location=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, table=test_hbase_ha_load_test_tool_hbase, region=94f6ca283dbb4445b2bcdc321b734d28reported OPEN on server=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 but state has otherwise. at org.apache.hadoop.hbase.master.assignment.AssignmentManager.checkOnlineRegionsReport(AssignmentManager.java:1065) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.reportOnlineRegions(AssignmentManager.java:987) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerReport(MasterRpcServices.java:459) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:13118) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304) Caused by: org.apache.hadoop.hbase.exceptions.UnexpectedStateException: rit=OPEN, location=ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, table=test_hbase_ha_load_test_tool_hbase, region=94f6ca283dbb4445b2bcdc321b734d28reported OPEN on server=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 but state has otherwise. at org.apache.hadoop.hbase.master.assignment.AssignmentManager.checkOnlineRegionsReport(AssignmentManager.java:1037) ... 7 more 2018-05-02 05:44:10,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 05:44:10,104 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 05:44:10,105 WARN [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] coordination.ZkSplitLogWorkerCoordination: Interrupted while trying to assert ownership of /hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474-splitting%2Fctr-e138-1518143905142-279227-01-000002.hwx.site%252C16020%252C1525239334474.meta.1525239585266.meta java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1386) at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1268) at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.setData(RecoverableZooKeeper.java:407) at org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination.attemptToOwnTask(ZkSplitLogWorkerCoordination.java:371) at org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination.grabTask(ZkSplitLogWorkerCoordination.java:241) at org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination.taskLoop(ZkSplitLogWorkerCoordination.java:441) at org.apache.hadoop.hbase.regionserver.SplitLogWorker.run(SplitLogWorker.java:138) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:44:10,105 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 exiting 2018-05-02 05:44:10,120 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 05:44:10,126 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 05:44:10,126 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 05:44:10,126 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 05:44:10,128 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 05:44:10,129 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 05:44:10,129 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 05:44:10,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager abruptly. 2018-05-02 05:44:10,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager abruptly. 2018-05-02 05:44:10,129 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,130 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,130 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,130 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,130 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing ce3059196e012fe2ffadcb5d2b348ce3, disabling compactions & flushes 2018-05-02 05:44:10,131 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:44:10,131 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,131 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,131 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 299ab8318d1b1d267135f988608683b7, disabling compactions & flushes 2018-05-02 05:44:10,131 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:44:10,131 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,131 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,131 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 05:44:10,131 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:44:10,131 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,132 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,132 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,132 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,133 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,133 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,133 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,134 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,134 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,134 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,134 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,135 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,135 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,135 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,136 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,136 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,136 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: aborting server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:44:10,136 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 05:44:10,137 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x71d0aebb to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 05:44:10,137 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:44:10,137 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 05:44:10,137 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 05:44:10,137 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 05:44:10,137 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,138 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 22 regions to close 2018-05-02 05:44:10,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,139 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,139 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:44:10,140 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ae147ad3,1525238855422.299ab8318d1b1d267135f988608683b7. 2018-05-02 05:44:10,140 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,140 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 1588230740, disabling compactions & flushes 2018-05-02 05:44:10,140 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region hbase:meta,,1.1588230740 2018-05-02 05:44:10,140 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 2fd8c4d5abf9928da8e8c547a0ca223a, disabling compactions & flushes 2018-05-02 05:44:10,140 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:44:10,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,141 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:44:10,141 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:44:10,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 05:44:10,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 05:44:10,141 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,141 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 931a5308337d39ab8fcac37d3a5e5844, disabling compactions & flushes 2018-05-02 05:44:10,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:44:10,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 735f841820ff0baa687bc402b169f4a6, disabling compactions & flushes 2018-05-02 05:44:10,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:44:10,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,149 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,150 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:44:10,150 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:44:10,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 05:44:10,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 05:44:10,150 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,150 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 26d4b78c3c7d2fdea4d32bb21a3ca5fe, disabling compactions & flushes 2018-05-02 05:44:10,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 59a7b13a4cf2cd2376c378f77087088d, disabling compactions & flushes 2018-05-02 05:44:10,150 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:44:10,151 ERROR [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Memstore data size is 39743 2018-05-02 05:44:10,151 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:44:10,151 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,151 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 05:44:10,151 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,151 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,151 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2018-05-02 05:44:10,151 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed hbase:meta,,1.1588230740 2018-05-02 05:44:10,153 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,153 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,153 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,153 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,153 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,153 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,153 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,154 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,154 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:44:10,153 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,154 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:44:10,154 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:44:10,154 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 05:44:10,154 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,d70a3d5f,1525238855422.26d4b78c3c7d2fdea4d32bb21a3ca5fe. 2018-05-02 05:44:10,154 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 05:44:10,154 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,154 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,154 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing a0792481dc7d859b1b63b04bf9adad81, disabling compactions & flushes 2018-05-02 05:44:10,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 05:44:10,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 05:44:10,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:44:10,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:44:10,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:44:10,184 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,184 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,184 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,184 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,184 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:44:10,184 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,47ae1475,1525238855422.a0792481dc7d859b1b63b04bf9adad81. 2018-05-02 05:44:10,184 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,184 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,185 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,185 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,185 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,185 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,185 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 3bbeffd33dfc99ea8862c8eae819df62, disabling compactions & flushes 2018-05-02 05:44:10,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:44:10,186 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:44:10,186 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:44:10,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 05:44:10,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 05:44:10,186 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,187 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing e75a388bc2011feed75bdc1a0e99a9a9, disabling compactions & flushes 2018-05-02 05:44:10,187 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:44:10,188 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,189 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 05:44:10,189 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:44:10,194 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,194 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,195 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:44:10,195 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:44:10,196 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 05:44:10,196 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 05:44:10,196 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,196 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,196 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing da9e02fc1fdd80392463141e6bc6cf96, disabling compactions & flushes 2018-05-02 05:44:10,197 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:44:10,197 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing ffde9f4a59ab08d4830f3b671f736ad5, disabling compactions & flushes 2018-05-02 05:44:10,197 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:44:10,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,201 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:44:10,201 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:44:10,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 05:44:10,201 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:44:10,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,d70a3d5f,1525237868269.da9e02fc1fdd80392463141e6bc6cf96. 2018-05-02 05:44:10,202 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,eb851ea5,1525238855422.e75a388bc2011feed75bdc1a0e99a9a9. 2018-05-02 05:44:10,202 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,202 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 9c38689b653a37956f2ae7364b126f1b, disabling compactions & flushes 2018-05-02 05:44:10,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:44:10,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 84c55bda386b9aa62a8b4df75ca9b38c, disabling compactions & flushes 2018-05-02 05:44:10,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 2859fac3bc772763b3fd1621c2669f2b, disabling compactions & flushes 2018-05-02 05:44:10,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:44:10,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:44:10,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,209 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:44:10,209 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:44:10,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 05:44:10,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,209 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 05:44:10,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,210 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,210 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:44:10,210 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 05:44:10,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,70a3d701,1525237868269.2859fac3bc772763b3fd1621c2669f2b. 2018-05-02 05:44:10,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 78e8a528d65332a4f7661e8ab427a827, disabling compactions & flushes 2018-05-02 05:44:10,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:44:10,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 94f6ca283dbb4445b2bcdc321b734d28, disabling compactions & flushes 2018-05-02 05:44:10,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:44:10,213 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,213 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,213 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,213 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:44:10,213 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,0a3d70a3,1525237868269.78e8a528d65332a4f7661e8ab427a827. 2018-05-02 05:44:10,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 05:44:10,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 05:44:10,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 05:44:10,214 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:44:10,214 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 05:44:10,339 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474; all regions closed. 2018-05-02 05:44:10,340 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:44:10,362 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:44:10,390 ERROR [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Shutdown / close of WAL failed: org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: Client (=DFSClient_NONMAPREDUCE_-1796843001_1) is not the lease owner (=DFSClient_NONMAPREDUCE_-242036180_1: /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474-splitting/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474.meta.1525239585266.meta (inode 18496) [Lease. Holder: DFSClient_NONMAPREDUCE_-1796843001_1, pending creates: 1] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:2819) at org.apache.hadoop.hdfs.server.namenode.FSDirWriteFileOp.completeFileInternal(FSDirWriteFileOp.java:691) at org.apache.hadoop.hdfs.server.namenode.FSDirWriteFileOp.completeFile(FSDirWriteFileOp.java:677) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFile(FSNamesystem.java:2840) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.complete(NameNodeRpcServer.java:928) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.complete(ClientNamenodeProtocolServerSideTranslatorPB.java:605) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) 2018-05-02 05:44:10,391 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Shutdown / close exception details: org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException: Client (=DFSClient_NONMAPREDUCE_-1796843001_1) is not the lease owner (=DFSClient_NONMAPREDUCE_-242036180_1: /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474-splitting/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474.meta.1525239585266.meta (inode 18496) [Lease. Holder: DFSClient_NONMAPREDUCE_-1796843001_1, pending creates: 1] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:2819) at org.apache.hadoop.hdfs.server.namenode.FSDirWriteFileOp.completeFileInternal(FSDirWriteFileOp.java:691) at org.apache.hadoop.hdfs.server.namenode.FSDirWriteFileOp.completeFile(FSDirWriteFileOp.java:677) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFile(FSNamesystem.java:2840) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.complete(NameNodeRpcServer.java:928) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.complete(ClientNamenodeProtocolServerSideTranslatorPB.java:605) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:110) at org.apache.hadoop.hbase.regionserver.HRegionServer.shutdownWAL(HRegionServer.java:1443) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:1096) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.namenode.LeaseExpiredException): Client (=DFSClient_NONMAPREDUCE_-1796843001_1) is not the lease owner (=DFSClient_NONMAPREDUCE_-242036180_1: /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474-splitting/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525239334474.meta.1525239585266.meta (inode 18496) [Lease. Holder: DFSClient_NONMAPREDUCE_-1796843001_1, pending creates: 1] at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkLease(FSNamesystem.java:2819) at org.apache.hadoop.hdfs.server.namenode.FSDirWriteFileOp.completeFileInternal(FSDirWriteFileOp.java:691) at org.apache.hadoop.hdfs.server.namenode.FSDirWriteFileOp.completeFile(FSDirWriteFileOp.java:677) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.completeFile(FSNamesystem.java:2840) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.complete(NameNodeRpcServer.java:928) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.complete(ClientNamenodeProtocolServerSideTranslatorPB.java:605) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1491) at org.apache.hadoop.ipc.Client.call(Client.java:1437) at org.apache.hadoop.ipc.Client.call(Client.java:1347) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:228) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:116) at com.sun.proxy.$Proxy21.complete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.complete(ClientNamenodeProtocolTranslatorPB.java:544) at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy22.complete(Unknown Source) at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:372) at com.sun.proxy.$Proxy23.complete(Unknown Source) at org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:946) at org.apache.hadoop.hdfs.DFSOutputStream.completeFile(DFSOutputStream.java:904) at org.apache.hadoop.hdfs.DFSOutputStream.closeImpl(DFSOutputStream.java:887) at org.apache.hadoop.hdfs.DFSOutputStream.close(DFSOutputStream.java:842) at org.apache.hadoop.fs.FSDataOutputStream$PositionCache.close(FSDataOutputStream.java:72) at org.apache.hadoop.fs.FSDataOutputStream.close(FSDataOutputStream.java:101) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.close(ProtobufLogWriter.java:65) at org.apache.hadoop.hbase.regionserver.wal.FSHLog.doShutdown(FSHLog.java:424) at org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.shutdown(AbstractFSWAL.java:820) at org.apache.hadoop.hbase.wal.AbstractFSWALProvider.shutdown(AbstractFSWALProvider.java:154) at org.apache.hadoop.hbase.wal.WALFactory.shutdown(WALFactory.java:211) at org.apache.hadoop.hbase.regionserver.HRegionServer.shutdownWAL(HRegionServer.java:1440) ... 2 more 2018-05-02 05:44:10,392 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 05:44:10,394 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Leases: Closed leases 2018-05-02 05:44:10,395 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS]] on shutdown 2018-05-02 05:44:10,395 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 05:44:10,421 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.NettyRpcServer: Stopping server on /172.27.70.95:16020 2018-05-02 05:44:10,421 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 05:44:10,422 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 05:44:10,466 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474 2018-05-02 05:44:10,468 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x2631f08d939007b, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 05:44:10,473 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ZooKeeper: Session: 0x2631f08d939007b closed 2018-05-02 05:44:10,474 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 05:44:10,474 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525239334474; zookeeper connection closed. 2018-05-02 05:44:10,475 ERROR [main] regionserver.HRegionServerCommandLine: Region server exiting java.lang.RuntimeException: HRegionServer Aborted at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:67) at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:87) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:149) at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2995) 2018-05-02 05:44:10,504 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 05:44:10,505 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 05:44:10,505 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 05:44:10,505 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 05:44:10,505 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 05:44:10,505 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 05:44:10,505 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 05:44:10,505 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 05:44:10,505 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 0 milli seconds 2018-05-02 05:44:10,505 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 05:44:10,505 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 05:44:10,505 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 05:44:10,505 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 05:44:10,505 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 05:44:10,506 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=02:52.900 minutes, events=2, succcessCount=2, totalEvents=14, totalSuccessCount=14 2018-05-02 05:44:10,506 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 05:44:10,507 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:00:34 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000002.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1031588 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:00:38,898 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:00:38,902 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:00:38,902 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:00:38,902 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:00:38,902 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:00:39,780 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:00:39,780 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:00:39,780 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:00:39,780 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:00:39,783 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:00:39,783 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:00:39,783 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:00:39,783 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:00:39,783 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:00:39,783 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:00:39,783 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:00:39,783 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:00:39,784 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:00:39,784 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:00:39,784 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:00:39,784 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:00:39,784 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:00:39,784 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:00:39,784 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:00:39,784 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:00:39,785 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:00:39,785 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:00:39,786 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:00:39,786 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:00:39,786 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:00:39,786 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:00:39,786 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:00:39,786 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020600 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:00:39,787 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:00:39,788 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:00:39,788 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:00:39,788 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log 2018-05-02 06:00:39,788 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:00:39,788 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:00:39,788 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:00:39,788 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:00:39,788 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=409596 2018-05-02 06:00:39,788 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:00:39,789 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:00:39,789 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:00:39,789 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:00:39,789 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:00:39,789 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:00:39,789 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:00:39,789 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:00:39,795 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:00:39,797 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020600 2018-05-02 06:00:39,799 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:00:39,800 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:00:39,800 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:00:39,800 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:00:39,803 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:00:39,803 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:00:39,803 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:00:39,803 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:00:39,803 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:00:39,805 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:00:39,806 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020600, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:00:40,131 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:00:41,267 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:00:41,452 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:00:42,372 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:00:42,380 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:00:43,118 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:00:43,118 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:00:43,118 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:00:43,279 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:00:43,596 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:00:43,596 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:00:43,682 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:00:44,713 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 server-side Connection retries=105 2018-05-02 06:00:44,736 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:00:44,738 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:00:44,739 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:00:44,739 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:00:44,739 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:00:44,739 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:00:44,942 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:00:45,252 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:00:45,275 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:00:45,453 INFO [main] ipc.NettyRpcServer: Bind to /172.27.70.95:16020 2018-05-02 06:00:45,766 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:00:45,770 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:00:45,772 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:00:45,787 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:00:45,788 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:00:45,794 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:00:48,242 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:00:48,265 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:00:48,367 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:00:48,378 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:00:48,379 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:00:48,379 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:00:48,379 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:00:48,379 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:00:48,379 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:00:48,380 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:00:48,380 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:00:48,380 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:00:48,380 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:00:48,380 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:00:48,380 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=4.15.12-1.el7.elrepo.x86_64 2018-05-02 06:00:48,380 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:00:48,380 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:00:48,381 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:00:48,382 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:00:48,434 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:00:48,451 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:00:48,457 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:00:48,492 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:00:48,495 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:00:48 UTC 2018 2018-05-02 06:00:48,495 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:00:48 UTC 2018 2018-05-02 06:00:48,495 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 02:01:12 UTC 2018 2018-05-02 06:00:48,509 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:00:48,523 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00ee, negotiated timeout = 90000 2018-05-02 06:00:48,527 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:00:48,528 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee connected 2018-05-02 06:00:48,568 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:00:48,659 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:00:48,659 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:00:48,659 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:00:48,659 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:00:48,660 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:00:48,666 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:00:48,768 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:00:48,787 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:00:48,790 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:00:48,831 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:00:48,864 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:00:49,041 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:00:49,041 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:00:49,041 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:00:49,087 INFO [main] util.log: Logging initialized @12033ms 2018-05-02 06:00:49,221 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:00:49,244 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:00:49,244 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:00:49,249 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:00:49,249 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:00:49,249 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:00:49,298 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:00:49,300 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:00:49,371 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:00:49,372 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:00:49,794 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:00:49,803 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000002.hwx.site,h=[ctr-e138-1518143905142-279227-01-000002.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:00:49,829 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:00:49,830 INFO [main] server.Server: Started @12775ms 2018-05-02 06:00:49,901 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:00:49,912 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:00:49,941 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:00:49,942 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:00:49,951 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:00:49,994 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Connect 0x004aba65 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:00:50,012 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x004aba65] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$39/1554826602@19ae409b 2018-05-02 06:00:50,023 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x004aba65-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:00:50,025 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x004aba65-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:00:50,034 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x004aba65-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:00:50,038 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x004aba65-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00ef, negotiated timeout = 90000 2018-05-02 06:00:50,120 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c4e2923, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:00:50,124 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43d22088, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:0 2018-05-02 06:00:50,138 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000002:16020 2018-05-02 06:00:50,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:00:50,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:00:50,214 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:00:50,215 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:00:50,215 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:00:50,215 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:00:50,215 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:00:50,216 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:00:50,216 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:00:50,216 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:00:50,216 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:00:50,216 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:00:50,216 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:00:50,216 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:00:50,456 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:00:50,463 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:00:50,467 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:00:50,467 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:00:50,470 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:00:50,471 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:00:50,513 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:00:50,513 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:00:50,513 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:00:50,513 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:00:50,513 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:00:50,513 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:00:50,514 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:00:50,515 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:00:50,524 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:00:50,524 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:00:50,524 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:00:50,524 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:00:50,524 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:00:50,525 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:00:50,525 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:00:50,525 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:00:50,525 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:00:50,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:00:50,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:00:50,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:00:50,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:00:50,578 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:00:50,615 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:00:50,615 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:00:50,617 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:00:50,617 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:00:50,617 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:00:50,617 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:00:50,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:00:50,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:00:50,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:00:50,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:00:50,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:00:50,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:00:50,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:00:50,625 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:00:50,626 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:00:50,626 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:00:50,626 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:00:50,626 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:00:50,626 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:00:50,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:00:50,628 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:00:50,628 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:00:50,628 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:00:50,628 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:00:50,629 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:00:50,629 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:00:50,630 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:00:50,630 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:00:50,630 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:00:50,630 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:00:50,631 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:00:50,631 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:00:50,631 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:00:50,635 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:00:50,644 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:00:50,644 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:00:50,895 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:00:51,255 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:00:53,513 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:00:53,641 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:00:53,642 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:00:53,748 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:00:53,749 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:00:53,749 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:00:53,751 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:00:53,751 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:00:53,771 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000003.hwx.site,20000,1525239798055 with port=16020, startcode=1525240839855 2018-05-02 06:00:53,955 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:00:53,956 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:00:53,957 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:00:54,079 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:00:54,093 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:00:54,128 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:00:54,132 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:00:54,133 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:00:54,134 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:00:54,134 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:00:54,257 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:00:54,257 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:00:54,257 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:00:54,318 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:00:54,333 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:00:54,666 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:00:54,681 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:00:54,721 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:00:54,738 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:00:54,742 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:00:54,769 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:00:54,916 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:00:54,916 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:00:54,916 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:00:54,917 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:00:54,917 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:00:54,917 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:00:54,917 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:00:54,920 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:00:55,085 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 starting 2018-05-02 06:00:55,088 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:00:55,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:00:55,102 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:00:55,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:00:55,117 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:00:55,141 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855] other RSs: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855] 2018-05-02 06:00:55,242 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855, RpcServer on ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:16020, sessionid=0x1631f08b26c00ee 2018-05-02 06:00:55,242 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:00:55,243 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:00:55,243 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855' 2018-05-02 06:00:55,243 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:00:55,250 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:00:55,251 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:00:55,251 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:00:55,251 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:00:55,251 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855' 2018-05-02 06:00:55,251 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:00:55,257 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:00:55,258 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:00:55,258 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:00:55,258 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:00:58,355 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525240839855, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:00:58,845 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Slow sync cost: 351 ms, current pipeline: [] 2018-05-02 06:00:58,846 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525240839855.1525240858356 2018-05-02 06:00:58,846 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:01:47,258 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 2018-05-02 06:01:47,271 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525239425826 znode expired, triggering replicatorRemoved event 2018-05-02 06:01:47,273 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:01:47,773 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:01:47,779 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:01:47,779 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,789 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:01:47,801 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,801 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:01:47,802 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:01:47,803 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:01:47,804 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:01:47,950 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:01:48,093 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:01:48,110 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:01:48,165 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => 084aa7d8a3bd4d7483494d5a2c39d5df, NAME => 'test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 06:01:48,165 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => 735f841820ff0baa687bc402b169f4a6, NAME => 'test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:01:48,165 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1182d8ac9fbcff5334cd5fda2cf0c4a0, NAME => 'test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:01:48,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AuthenticationService 2018-05-02 06:01:48,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AuthenticationService 2018-05-02 06:01:48,266 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:48,266 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:48,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AuthenticationService 2018-05-02 06:01:48,271 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:01:48,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=SecureBulkLoadService 2018-05-02 06:01:48,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=SecureBulkLoadService 2018-05-02 06:01:48,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:48,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:48,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:48,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AccessControlService 2018-05-02 06:01:48,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:48,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:48,279 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:48,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:48,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:48,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AccessControlService 2018-05-02 06:01:48,280 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:48,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:48,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=SecureBulkLoadService 2018-05-02 06:01:48,280 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:01:48,281 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:01:48,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:01:48,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AccessControlService 2018-05-02 06:01:48,281 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:01:48,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:01:48,356 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 735f841820ff0baa687bc402b169f4a6 2018-05-02 06:01:48,356 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 06:01:48,356 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:01:48,357 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:01:48,357 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:01:48,363 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:01:48,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:48,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:48,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:01:48,575 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 06:01:48,575 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:01:48,575 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:01:48,575 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:01:48,575 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 06:01:48,575 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:01:48,626 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,627 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,648 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,653 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,653 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:01:48,658 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:01:48,897 WARN [StoreFileOpenerThread-test_cf-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #48 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 06:01:48,900 WARN [StoreFileOpenerThread-test_cf-1] retry.RetryInvocationHandler: A failover has occurred since the start of call #47 ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 2018-05-02 06:01:48,949 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf/701b265951a9459fbb2a9068086da9e9 2018-05-02 06:01:48,949 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf/9f7cb69b6abe4f57bb56248fe3e04156 2018-05-02 06:01:48,949 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf/ae5922ae05e649f79a208a0ea340ccb0 2018-05-02 06:01:48,953 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,953 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:48,954 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:01:49,013 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:01:49,013 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6 2018-05-02 06:01:49,014 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 06:01:49,110 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12237.seqid, newMaxSeqId=12237, maxSeqId=12236 2018-05-02 06:01:49,111 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13638.seqid, newMaxSeqId=13638, maxSeqId=13637 2018-05-02 06:01:49,117 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12596.seqid, newMaxSeqId=12596, maxSeqId=12595 2018-05-02 06:01:49,121 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 1182d8ac9fbcff5334cd5fda2cf0c4a0; next sequenceid=13638 2018-05-02 06:01:49,130 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 735f841820ff0baa687bc402b169f4a6; next sequenceid=12237 2018-05-02 06:01:49,131 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened 084aa7d8a3bd4d7483494d5a2c39d5df; next sequenceid=12596 2018-05-02 06:01:49,236 INFO [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:01:49,236 INFO [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:01:49,236 INFO [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:01:49,286 DEBUG [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:01:49,287 DEBUG [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:01:49,287 DEBUG [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:01:49,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:01:49,288 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:01:49,287 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:01:50,075 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x004aba65] zookeeper.ZooKeeper: Session: 0x1631f08b26c00ef closed 2018-05-02 06:01:50,075 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x004aba65-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:01:50,646 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.028 minutes, events=2, totalEvents=2 2018-05-02 06:01:50,684 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@23cce75c 2018-05-02 06:01:50,686 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:01:50,688 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:01:50,688 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:01:50,696 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c00f0, negotiated timeout = 10000 2018-05-02 06:01:50,771 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 06:01:50,784 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 06:01:53,357 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:01:53,359 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:01:53,361 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:01:53,874 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:01:54,276 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:01:54,276 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:01:54,355 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:01:54,355 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:01:54,355 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:01:54,361 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:01:54,364 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:01:54,364 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:01:54,395 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:01:54,395 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 06:01:54,395 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:01:54,395 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 06:01:54,396 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:01:54,396 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 06:01:54,725 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:01:54,725 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:02:28,246 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:02:50,650 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=2, succcessCount=2, totalEvents=4, totalSuccessCount=2 2018-05-02 06:03:22,979 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:03:22,984 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:03:22,993 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:03:22,997 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:03:22,997 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:03:22,998 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:03:22,998 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:03:22,998 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:03:22,998 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:03:22,998 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/5 2018-05-02 06:03:22,999 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:03:23,007 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267 2018-05-02 06:03:23,011 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525239522267 znode expired, triggering replicatorRemoved event 2018-05-02 06:03:23,011 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:03:23,638 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:03:23,701 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:03:23,702 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:03:23,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => 682775c01c8d957d744ae2b280c815cd, NAME => 'test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 06:03:23,703 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=AuthenticationService 2018-05-02 06:03:23,703 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=SecureBulkLoadService 2018-05-02 06:03:23,704 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,704 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,704 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,704 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=AccessControlService 2018-05-02 06:03:23,705 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,705 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,705 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 682775c01c8d957d744ae2b280c815cd 2018-05-02 06:03:23,706 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:03:23,706 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,711 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => c963eb77dbdc6dbab886dbe4eebba5ad, NAME => 'test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 06:03:23,711 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AuthenticationService 2018-05-02 06:03:23,712 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,712 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=SecureBulkLoadService 2018-05-02 06:03:23,712 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,712 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,712 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,712 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AccessControlService 2018-05-02 06:03:23,713 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,713 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 06:03:23,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:03:23,714 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,765 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 06:03:23,765 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 06:03:23,767 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,768 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,777 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:03:23,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => a97e624ee736c77fbc6ccefb3abbac31, NAME => 'test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31.', STARTKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A', ENDKEY => '\x0DyC^P\xD7\x944'} 2018-05-02 06:03:23,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=AuthenticationService 2018-05-02 06:03:23,779 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=SecureBulkLoadService 2018-05-02 06:03:23,780 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,780 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,780 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=AccessControlService 2018-05-02 06:03:23,780 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,780 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,781 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am a97e624ee736c77fbc6ccefb3abbac31 2018-05-02 06:03:23,781 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:03:23,781 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,783 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:03:23,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => b52f5cecdefd18652f3e796b8dada29f, NAME => 'test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f.', STARTKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E', ENDKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8'} 2018-05-02 06:03:23,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=AuthenticationService 2018-05-02 06:03:23,784 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=SecureBulkLoadService 2018-05-02 06:03:23,784 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,785 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,785 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=AccessControlService 2018-05-02 06:03:23,785 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,785 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b52f5cecdefd18652f3e796b8dada29f 2018-05-02 06:03:23,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:03:23,786 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,789 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf 2018-05-02 06:03:23,789 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf 2018-05-02 06:03:23,790 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,820 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:03:23,821 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => a8ff96226d546f0ea151823ae73e5a1b, NAME => 'test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 06:03:23,822 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AuthenticationService 2018-05-02 06:03:23,822 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,822 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,822 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=SecureBulkLoadService 2018-05-02 06:03:23,822 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,822 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,822 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,823 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AccessControlService 2018-05-02 06:03:23,823 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,823 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,823 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:03:23,823 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:03:23,824 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,825 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1 2018-05-02 06:03:23,825 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1 2018-05-02 06:03:23,826 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:03:23,826 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,828 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => 8c7dd0ad2a67fa6a32d1f3694eef56eb, NAME => 'test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 06:03:23,828 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AuthenticationService 2018-05-02 06:03:23,828 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,828 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=SecureBulkLoadService 2018-05-02 06:03:23,829 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,829 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,829 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,831 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AccessControlService 2018-05-02 06:03:23,832 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,833 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:03:23,835 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => 843b3b66a19c1c2d494720e99edc9c52, NAME => 'test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52.', STARTKEY => '/(k\xCA\x1A\xF2\x86\xB6', ENDKEY => '5\xE5\x0DyC^P\xD0'} 2018-05-02 06:03:23,835 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=AuthenticationService 2018-05-02 06:03:23,835 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,836 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=SecureBulkLoadService 2018-05-02 06:03:23,836 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,836 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,836 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,836 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=AccessControlService 2018-05-02 06:03:23,836 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,836 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,837 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,838 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 843b3b66a19c1c2d494720e99edc9c52 2018-05-02 06:03:23,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:03:23,842 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:03:23,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:03:23,845 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,846 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => c078deb2474e9c19b85b5fdb9efaa47d, NAME => 'test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 06:03:23,847 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AuthenticationService 2018-05-02 06:03:23,847 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:03:23,847 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=SecureBulkLoadService 2018-05-02 06:03:23,847 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:03:23,847 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:03:23,847 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:03:23,848 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. service=AccessControlService 2018-05-02 06:03:23,848 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1 2018-05-02 06:03:23,848 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1 2018-05-02 06:03:23,848 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:03:23,848 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:03:23,857 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 06:03:23,857 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:03:23,853 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,849 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,858 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:03:23,861 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,916 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:03:23,916 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:03:23,917 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,920 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,941 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:03:23,941 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:03:23,958 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:23,959 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:23,994 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c 2018-05-02 06:03:23,995 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,036 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1 2018-05-02 06:03:24,036 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1 2018-05-02 06:03:24,045 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:24,056 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf/3dabedf14f6c4208ad17e7be0d53907d 2018-05-02 06:03:24,056 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,057 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:24,062 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 06:03:24,062 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf 2018-05-02 06:03:24,063 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:03:24,064 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:03:24,072 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 06:03:24,127 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd 2018-05-02 06:03:24,136 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1/c0a6bd8873ac486db9e40f6c058b5bcd 2018-05-02 06:03:24,136 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,147 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f 2018-05-02 06:03:24,168 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1/586a58cac1d944569e94cf4983feab67 2018-05-02 06:03:24,189 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1/21db71a596184e8987d3b0a857d2a3d8 2018-05-02 06:03:24,190 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12238.seqid, newMaxSeqId=12238, maxSeqId=12237 2018-05-02 06:03:24,210 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened c963eb77dbdc6dbab886dbe4eebba5ad; next sequenceid=12238 2018-05-02 06:03:24,214 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/recovered.edits/12499.seqid, newMaxSeqId=12499, maxSeqId=12498 2018-05-02 06:03:24,217 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf/003bd718e756495284dd200779f4eb8a 2018-05-02 06:03:24,217 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,220 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52 2018-05-02 06:03:24,221 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf/0ccbc430bfe6442db21c7e11d482c2f8 2018-05-02 06:03:24,221 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,233 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened 682775c01c8d957d744ae2b280c815cd; next sequenceid=12499 2018-05-02 06:03:24,234 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:03:24,235 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1/8e427e1bd0004b8fa56fee85c7cc2ff5 2018-05-02 06:03:24,237 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,238 INFO [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:03:24,240 DEBUG [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/test_cf/0c830418052d48119c37552925d65824 2018-05-02 06:03:24,240 INFO [StoreOpener-c078deb2474e9c19b85b5fdb9efaa47d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:03:24,242 INFO [PostOpenDeployTasks:682775c01c8d957d744ae2b280c815cd] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:03:24,249 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened b52f5cecdefd18652f3e796b8dada29f; next sequenceid=408 2018-05-02 06:03:24,251 DEBUG [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:03:24,254 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:03:24,257 DEBUG [PostOpenDeployTasks:682775c01c8d957d744ae2b280c815cd] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:03:24,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:03:24,260 INFO [PostOpenDeployTasks:b52f5cecdefd18652f3e796b8dada29f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:03:24,266 DEBUG [PostOpenDeployTasks:b52f5cecdefd18652f3e796b8dada29f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:03:24,266 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:03:24,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:03:24,280 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:03:24,292 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d 2018-05-02 06:03:24,314 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31 2018-05-02 06:03:24,462 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:03:24,472 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11353.seqid, newMaxSeqId=11353, maxSeqId=11352 2018-05-02 06:03:24,476 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened 843b3b66a19c1c2d494720e99edc9c52; next sequenceid=408 2018-05-02 06:03:24,480 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12792.seqid, newMaxSeqId=12792, maxSeqId=12791 2018-05-02 06:03:24,485 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened c078deb2474e9c19b85b5fdb9efaa47d; next sequenceid=11353 2018-05-02 06:03:24,485 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:03:24,490 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11451.seqid, newMaxSeqId=11451, maxSeqId=11450 2018-05-02 06:03:24,495 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened 8c7dd0ad2a67fa6a32d1f3694eef56eb; next sequenceid=12792 2018-05-02 06:03:24,498 INFO [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:03:24,506 INFO [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:03:24,509 INFO [PostOpenDeployTasks:843b3b66a19c1c2d494720e99edc9c52] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:03:24,510 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened a97e624ee736c77fbc6ccefb3abbac31; next sequenceid=411 2018-05-02 06:03:24,512 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened a8ff96226d546f0ea151823ae73e5a1b; next sequenceid=11451 2018-05-02 06:03:24,514 DEBUG [PostOpenDeployTasks:c078deb2474e9c19b85b5fdb9efaa47d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:03:24,515 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:03:24,524 DEBUG [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:03:24,524 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:03:24,529 INFO [PostOpenDeployTasks:a97e624ee736c77fbc6ccefb3abbac31] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:03:24,530 DEBUG [PostOpenDeployTasks:843b3b66a19c1c2d494720e99edc9c52] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:03:24,530 INFO [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:03:24,530 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:03:24,533 DEBUG [PostOpenDeployTasks:a97e624ee736c77fbc6ccefb3abbac31] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:03:24,534 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:03:24,538 DEBUG [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:03:24,540 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:03:24,741 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:03:26,653 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:36.006 minutes, events=2, succcessCount=2, totalEvents=2, totalSuccessCount=2 2018-05-02 06:03:28,706 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:03:28,709 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:03:28,719 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:03:29,232 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:03:29,848 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:03:29,852 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:03:30,106 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:03:30,106 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:03:30,106 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:03:30,136 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:03:30,144 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:03:30,144 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:03:50,653 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=6, succcessCount=3, totalEvents=10, totalSuccessCount=5 2018-05-02 06:03:57,563 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:04:13,262 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:04:13,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => 2fd8c4d5abf9928da8e8c547a0ca223a, NAME => 'test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:04:13,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AuthenticationService 2018-05-02 06:04:13,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:13,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=SecureBulkLoadService 2018-05-02 06:04:13,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:13,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:13,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:13,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AccessControlService 2018-05-02 06:04:13,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:13,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:13,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 06:04:13,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:04:13,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:13,293 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 06:04:13,293 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 06:04:13,294 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:13,295 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:13,323 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf/99bf1b2ad42a4ca9af12e2d310e96ee0 2018-05-02 06:04:13,323 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:13,331 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 06:04:13,370 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12318.seqid, newMaxSeqId=12318, maxSeqId=12317 2018-05-02 06:04:13,375 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened 2fd8c4d5abf9928da8e8c547a0ca223a; next sequenceid=12318 2018-05-02 06:04:13,378 INFO [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:04:13,382 DEBUG [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:04:13,383 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:18,279 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:04:18,283 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:04:18,284 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:04:18,377 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:04:18,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:04:18,398 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 06:04:18,398 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:18,398 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 06:04:18,398 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:18,398 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:18,398 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:18,399 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 06:04:18,399 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:18,401 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:18,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:04:18,401 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:04:18,402 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:18,421 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:04:18,421 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:04:18,423 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:18,424 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:18,478 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 06:04:18,481 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:18,494 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:04:18,541 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12771.seqid, newMaxSeqId=12771, maxSeqId=12770 2018-05-02 06:04:18,547 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=12771 2018-05-02 06:04:18,556 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:04:18,560 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:04:18,561 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:18,581 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:04:18,596 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => 2e8da78a5421f95de8c75e0053e1d4a0, NAME => 'test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0.', STARTKEY => '\x945\xE5\x0DyC^<', ENDKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V'} 2018-05-02 06:04:18,596 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AuthenticationService 2018-05-02 06:04:18,597 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:18,597 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=SecureBulkLoadService 2018-05-02 06:04:18,597 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:18,597 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:18,597 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:18,597 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AccessControlService 2018-05-02 06:04:18,598 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:18,598 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:18,598 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:04:18,598 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:04:18,599 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:18,617 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:04:18,617 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:04:18,618 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:18,619 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:18,689 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1/4a57c45b7e83443f9ac51c1f0ee9e848 2018-05-02 06:04:18,690 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:18,701 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:04:18,743 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:04:18,749 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened 2e8da78a5421f95de8c75e0053e1d4a0; next sequenceid=411 2018-05-02 06:04:18,753 INFO [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:04:18,757 DEBUG [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:04:18,758 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:18,803 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:04:19,143 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:04:19,144 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:04:19,298 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:04:19,298 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:04:19,298 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:04:19,306 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:04:19,470 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:04:19,470 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:04:19,627 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:04:19,641 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opening region: {ENCODED => 3f499471b0415a38ad5efe046913cba2, NAME => 'test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2.', STARTKEY => '\xDEP\xD7\x945\xE5\x0DZ', ENDKEY => '\xE5\x0DyC^P\xD7t'} 2018-05-02 06:04:19,641 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AuthenticationService 2018-05-02 06:04:19,641 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:19,641 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=SecureBulkLoadService 2018-05-02 06:04:19,641 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:19,642 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:19,642 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:19,643 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AccessControlService 2018-05-02 06:04:19,643 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:19,643 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:19,643 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3f499471b0415a38ad5efe046913cba2 2018-05-02 06:04:19,643 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:04:19,644 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:19,657 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:04:19,657 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:04:19,658 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:19,659 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:19,691 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1/abc0da0f84f64790a2c93880ca66ac5e 2018-05-02 06:04:19,692 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:19,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2 2018-05-02 06:04:19,746 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:04:19,752 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opened 3f499471b0415a38ad5efe046913cba2; next sequenceid=411 2018-05-02 06:04:19,755 INFO [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:04:19,758 DEBUG [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:04:19,758 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:20,668 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:04:20,691 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:04:20,691 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:04:20,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 06:04:20,692 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:20,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 06:04:20,692 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:20,692 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:20,692 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:20,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 06:04:20,693 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:20,693 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:20,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:04:20,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:04:20,710 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:04:20,710 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:04:20,713 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:20,715 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:20,725 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opening region: {ENCODED => 29fe0b7866912efc70bb3f2d7fd83059, NAME => 'test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 06:04:20,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AuthenticationService 2018-05-02 06:04:20,726 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:20,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=SecureBulkLoadService 2018-05-02 06:04:20,726 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:20,726 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:20,726 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:20,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AccessControlService 2018-05-02 06:04:20,727 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:20,727 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:20,727 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:04:20,727 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:04:20,727 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:20,741 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:04:20,741 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:04:20,743 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:20,744 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:20,761 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 06:04:20,761 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:20,768 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:04:20,799 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=30 2018-05-02 06:04:20,815 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=31 2018-05-02 06:04:20,828 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf/25e0a99365ef45e2b122cf95cdb0162d 2018-05-02 06:04:20,828 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:20,846 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:04:20,851 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:04:20,856 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:04:20,856 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:20,881 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12755.seqid, newMaxSeqId=12755, maxSeqId=12754 2018-05-02 06:04:20,886 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opened 29fe0b7866912efc70bb3f2d7fd83059; next sequenceid=12755 2018-05-02 06:04:20,890 INFO [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:04:20,895 DEBUG [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:04:20,895 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:22,001 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:04:22,018 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opening region: {ENCODED => 40744bb706fe10eab3c8964d0c6b003e, NAME => 'test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e.', STARTKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A', ENDKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4'} 2018-05-02 06:04:22,019 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AuthenticationService 2018-05-02 06:04:22,020 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:22,020 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=SecureBulkLoadService 2018-05-02 06:04:22,020 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:22,020 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:22,020 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:22,021 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AccessControlService 2018-05-02 06:04:22,021 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:22,021 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:22,021 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:04:22,021 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:04:22,022 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:22,038 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 06:04:22,038 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 06:04:22,039 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:22,040 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:22,071 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1/cf8ea72ad4194e3f960735c6f0ad0ee0 2018-05-02 06:04:22,071 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:22,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:04:22,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:04:22,112 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opened 40744bb706fe10eab3c8964d0c6b003e; next sequenceid=408 2018-05-02 06:04:22,116 INFO [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:04:22,125 DEBUG [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:04:22,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:23,402 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:04:23,414 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:04:23,432 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:04:23,937 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:04:24,211 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:04:24,231 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opening region: {ENCODED => 5fc7cfd582bc270c530fe9787011078c, NAME => 'test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c.', STARTKEY => '!\xAF(k\xCA\x1A\xF2\x82', ENDKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C'} 2018-05-02 06:04:24,231 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=AuthenticationService 2018-05-02 06:04:24,231 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:24,232 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=SecureBulkLoadService 2018-05-02 06:04:24,232 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:24,232 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:24,232 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:24,232 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=AccessControlService 2018-05-02 06:04:24,232 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:24,232 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:24,233 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 5fc7cfd582bc270c530fe9787011078c 2018-05-02 06:04:24,233 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:04:24,233 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:24,265 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1 2018-05-02 06:04:24,265 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1 2018-05-02 06:04:24,271 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:24,272 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:24,330 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1/94cb8f2a93da4c488fdc446518fd1cc5 2018-05-02 06:04:24,385 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1/dbd2816429b24832a77a1b06377230f4 2018-05-02 06:04:24,386 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:24,394 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c 2018-05-02 06:04:24,426 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:04:24,432 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opened 5fc7cfd582bc270c530fe9787011078c; next sequenceid=411 2018-05-02 06:04:24,451 INFO [PostOpenDeployTasks:5fc7cfd582bc270c530fe9787011078c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:04:24,458 DEBUG [PostOpenDeployTasks:5fc7cfd582bc270c530fe9787011078c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:04:24,459 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:24,493 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:04:24,494 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:04:24,864 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:04:24,864 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:04:24,865 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:04:24,908 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:04:24,928 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:04:24,928 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:04:25,240 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:04:25,258 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:04:25,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opening region: {ENCODED => aa977fc80ff408457e9257d2ab7afdf2, NAME => 'test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:04:25,259 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AuthenticationService 2018-05-02 06:04:25,259 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:25,259 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=SecureBulkLoadService 2018-05-02 06:04:25,259 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:25,259 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:25,259 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:25,259 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. service=AccessControlService 2018-05-02 06:04:25,260 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:25,260 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:25,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:04:25,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:04:25,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:25,282 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opening region: {ENCODED => 84c55bda386b9aa62a8b4df75ca9b38c, NAME => 'test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 06:04:25,282 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:04:25,282 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf 2018-05-02 06:04:25,283 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AuthenticationService 2018-05-02 06:04:25,284 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:25,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=SecureBulkLoadService 2018-05-02 06:04:25,284 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:25,284 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:25,284 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:25,284 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:25,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AccessControlService 2018-05-02 06:04:25,285 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:25,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:25,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 06:04:25,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:04:25,286 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:25,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:25,304 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 06:04:25,304 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 06:04:25,305 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:25,306 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:25,341 DEBUG [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/test_cf/2824b9271dd345d7b1f1d94e7ff12b82 2018-05-02 06:04:25,341 INFO [StoreOpener-aa977fc80ff408457e9257d2ab7afdf2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:25,371 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2 2018-05-02 06:04:25,382 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf/e85dca4d9952403a8e861bb27c95db92 2018-05-02 06:04:25,382 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:25,412 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 06:04:25,418 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12534.seqid, newMaxSeqId=12534, maxSeqId=12533 2018-05-02 06:04:25,423 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opened aa977fc80ff408457e9257d2ab7afdf2; next sequenceid=12534 2018-05-02 06:04:25,426 INFO [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:04:25,439 DEBUG [PostOpenDeployTasks:aa977fc80ff408457e9257d2ab7afdf2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:04:25,439 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:25,442 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11881.seqid, newMaxSeqId=11881, maxSeqId=11880 2018-05-02 06:04:25,448 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opened 84c55bda386b9aa62a8b4df75ca9b38c; next sequenceid=11881 2018-05-02 06:04:25,454 INFO [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:04:25,458 DEBUG [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:04:25,459 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:25,501 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:04:26,194 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:04:26,210 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => 93f2d602c0a0a654856fb16863c2ff38, NAME => 'test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38.', STARTKEY => '\x0DyC^P\xD7\x944', ENDKEY => '\x145\xE5\x0DyC^N'} 2018-05-02 06:04:26,210 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AuthenticationService 2018-05-02 06:04:26,211 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:26,211 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=SecureBulkLoadService 2018-05-02 06:04:26,211 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:26,211 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:26,211 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:26,211 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AccessControlService 2018-05-02 06:04:26,211 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:26,211 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:26,212 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:04:26,212 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:04:26,212 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:26,246 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:04:26,246 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:04:26,247 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:26,248 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:26,294 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1/da3881a0cb0542f0a0fdfe2ffd2e6aba 2018-05-02 06:04:26,295 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:26,306 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:04:26,340 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:04:26,347 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 93f2d602c0a0a654856fb16863c2ff38; next sequenceid=411 2018-05-02 06:04:26,350 INFO [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:04:26,356 DEBUG [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:04:26,356 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:26,423 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:04:26,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => f3ccd3e0671152671071dbba3e2cb560, NAME => 'test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 06:04:26,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AuthenticationService 2018-05-02 06:04:26,433 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:26,433 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=SecureBulkLoadService 2018-05-02 06:04:26,434 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:26,434 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:26,434 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:26,434 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AccessControlService 2018-05-02 06:04:26,434 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:26,434 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:26,435 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3ccd3e0671152671071dbba3e2cb560 2018-05-02 06:04:26,435 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:04:26,435 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:26,450 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 06:04:26,450 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 06:04:26,451 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:26,452 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:26,490 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf/0a4f5f73439447d58ac2371e0ea69f1f 2018-05-02 06:04:26,499 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:26,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560 2018-05-02 06:04:26,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12794.seqid, newMaxSeqId=12794, maxSeqId=12793 2018-05-02 06:04:26,555 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened f3ccd3e0671152671071dbba3e2cb560; next sequenceid=12794 2018-05-02 06:04:26,564 INFO [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:04:26,567 DEBUG [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:04:26,568 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:26,655 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=6, succcessCount=6, totalEvents=8, totalSuccessCount=8 2018-05-02 06:04:28,791 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:04:28,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 06:04:28,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 06:04:28,806 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:28,806 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 06:04:28,806 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:28,806 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:28,806 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:28,806 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 06:04:28,806 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:28,806 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:28,806 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:04:28,807 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:04:28,807 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:28,821 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:04:28,821 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:04:28,822 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:28,823 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:28,870 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 06:04:28,870 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:04:28,878 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:04:28,917 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12995.seqid, newMaxSeqId=12995, maxSeqId=12994 2018-05-02 06:04:28,924 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=12995 2018-05-02 06:04:28,942 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:04:28,947 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:04:28,947 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:04:29,233 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:04:29,234 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:04:29,236 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:04:29,746 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:04:30,022 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:04:30,023 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:04:30,283 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:04:30,283 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:04:30,283 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:04:30,292 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:04:30,294 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:04:30,294 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:04:31,365 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b." 2018-05-02 06:04:31,411 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close a8ff96226d546f0ea151823ae73e5a1b, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:31,416 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:31,416 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing a8ff96226d546f0ea151823ae73e5a1b, disabling compactions & flushes 2018-05-02 06:04:31,417 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:04:31,488 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11453.seqid, newMaxSeqId=11453, maxSeqId=11451 2018-05-02 06:04:31,493 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:31,495 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:31,496 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:31,497 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:04:31,498 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding a8ff96226d546f0ea151823ae73e5a1b move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=11451 2018-05-02 06:04:31,502 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:04:32,163 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad." 2018-05-02 06:04:32,163 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close c963eb77dbdc6dbab886dbe4eebba5ad, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:32,165 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb." 2018-05-02 06:04:32,165 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 8c7dd0ad2a67fa6a32d1f3694eef56eb, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:32,166 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:32,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing c963eb77dbdc6dbab886dbe4eebba5ad, disabling compactions & flushes 2018-05-02 06:04:32,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:04:32,169 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:32,169 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 8c7dd0ad2a67fa6a32d1f3694eef56eb, disabling compactions & flushes 2018-05-02 06:04:32,169 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:04:32,188 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12240.seqid, newMaxSeqId=12240, maxSeqId=12238 2018-05-02 06:04:32,193 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:32,193 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:32,193 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:32,193 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:04:32,193 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding c963eb77dbdc6dbab886dbe4eebba5ad move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=12238 2018-05-02 06:04:32,197 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:04:32,205 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12794.seqid, newMaxSeqId=12794, maxSeqId=12792 2018-05-02 06:04:32,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:32,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:32,210 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:32,211 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:04:32,212 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 8c7dd0ad2a67fa6a32d1f3694eef56eb move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=12792 2018-05-02 06:04:32,215 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:04:33,088 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d." 2018-05-02 06:04:33,088 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close c078deb2474e9c19b85b5fdb9efaa47d, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042. Requested from /172.27.61.83 2018-05-02 06:04:33,089 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0." 2018-05-02 06:04:33,089 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 1182d8ac9fbcff5334cd5fda2cf0c4a0, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:04:33,089 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:33,089 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing c078deb2474e9c19b85b5fdb9efaa47d, disabling compactions & flushes 2018-05-02 06:04:33,089 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:04:33,089 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:33,090 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 1182d8ac9fbcff5334cd5fda2cf0c4a0, disabling compactions & flushes 2018-05-02 06:04:33,090 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:04:33,111 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13640.seqid, newMaxSeqId=13640, maxSeqId=13638 2018-05-02 06:04:33,113 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c078deb2474e9c19b85b5fdb9efaa47d/recovered.edits/11355.seqid, newMaxSeqId=11355, maxSeqId=11353 2018-05-02 06:04:33,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:33,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:33,116 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:33,116 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:04:33,116 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 1182d8ac9fbcff5334cd5fda2cf0c4a0 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=13638 2018-05-02 06:04:33,120 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:04:33,120 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:04:33,120 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:04:33,120 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:04:33,120 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:04:33,120 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding c078deb2474e9c19b85b5fdb9efaa47d move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 record at close sequenceid=11353 2018-05-02 06:04:33,123 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,b851eb76,1525237868269.c078deb2474e9c19b85b5fdb9efaa47d. 2018-05-02 06:04:36,496 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:04:36,497 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:04:36,499 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:04:37,003 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:04:37,175 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:04:37,175 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:04:37,246 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:04:37,246 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:04:37,246 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:04:37,250 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:04:37,259 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:04:37,260 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:04:50,656 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=24, succcessCount=12, totalEvents=34, totalSuccessCount=17 2018-05-02 06:04:59,438 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 2018-05-02 06:04:59,441 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525239609353 znode expired, triggering replicatorRemoved event 2018-05-02 06:04:59,441 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:04:59,923 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:04:59,938 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:04:59,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => f61045f3bb8866c33d9b05635d777d75, NAME => 'test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75.', STARTKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C', ENDKEY => '/(k\xCA\x1A\xF2\x86\xB6'} 2018-05-02 06:04:59,939 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AuthenticationService 2018-05-02 06:04:59,940 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:59,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=SecureBulkLoadService 2018-05-02 06:04:59,940 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:59,940 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:59,940 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:59,940 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AccessControlService 2018-05-02 06:04:59,941 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:59,941 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:59,941 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:04:59,941 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:04:59,942 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,949 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:04:59,949 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 06:04:59,950 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:04:59,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 06:04:59,950 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:04:59,950 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:04:59,950 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:04:59,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 06:04:59,950 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:04:59,950 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:04:59,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 06:04:59,951 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:04:59,958 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:04:59,961 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:04:59,961 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:04:59,965 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:59,965 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:59,973 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:04:59,973 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:04:59,974 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:04:59,975 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:04:59,996 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/7f6cc973fc9141ee84218d1cf4abc1f2 2018-05-02 06:05:00,040 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 06:05:00,040 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:05:00,057 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 06:05:00,062 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/d5ac413ba8334de5a72f01d06da0f43f 2018-05-02 06:05:00,063 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:05:00,070 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:05:00,084 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12157.seqid, newMaxSeqId=12157, maxSeqId=12156 2018-05-02 06:05:00,094 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12157 2018-05-02 06:05:00,107 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:05:00,113 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened f61045f3bb8866c33d9b05635d777d75; next sequenceid=414 2018-05-02 06:05:00,115 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:05:00,119 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:05:00,119 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:05:00,129 INFO [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:05:00,134 DEBUG [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:05:00,135 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:05:04,941 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:05:04,942 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:05:04,946 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:05:05,453 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:05:05,759 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:05:05,759 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:05:05,863 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:05:05,863 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:05:05,863 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:05:05,868 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:05:05,871 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:05:05,871 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:05:35,127 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:05:45,784 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 06:05:50,658 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.002 minutes, events=4, succcessCount=2, totalEvents=38, totalSuccessCount=19 2018-05-02 06:05:55,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:05:55,118 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:06:41,073 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:06:41,074 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:06:41,076 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:06:41,076 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:06:41,080 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:06:41,081 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:06:41,088 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:06:41,088 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:06:41,088 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:06:41,088 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:06:41,088 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:06:41,088 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:06:41,088 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:06:41,088 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/6 2018-05-02 06:06:41,089 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:06:41,106 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 2018-05-02 06:06:41,111 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525239699656 znode expired, triggering replicatorRemoved event 2018-05-02 06:06:41,111 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:06:43,843 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:06:43,871 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:06:43,871 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => 3bbeffd33dfc99ea8862c8eae819df62, NAME => 'test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 06:06:43,871 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:06:43,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AuthenticationService 2018-05-02 06:06:43,872 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=SecureBulkLoadService 2018-05-02 06:06:43,873 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,873 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 06:06:43,873 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,873 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:06:43,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 06:06:43,873 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:06:43,873 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:06:43,873 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:06:43,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 06:06:43,874 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,874 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:06:43,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:06:43,875 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,873 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AccessControlService 2018-05-02 06:06:43,876 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:06:43,876 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:06:43,876 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 06:06:43,876 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:06:43,877 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:06:43,909 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 06:06:43,909 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 06:06:43,911 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,911 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,912 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:06:43,912 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:06:43,913 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:06:43,914 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:06:43,944 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf/081e4f87bb6141d5bac9d82300027aa3 2018-05-02 06:06:43,944 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:43,958 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 06:06:43,980 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 06:06:43,980 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:06:43,990 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:06:44,010 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12462.seqid, newMaxSeqId=12462, maxSeqId=12461 2018-05-02 06:06:44,024 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11468.seqid, newMaxSeqId=11468, maxSeqId=11467 2018-05-02 06:06:44,026 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened 3bbeffd33dfc99ea8862c8eae819df62; next sequenceid=12462 2018-05-02 06:06:44,033 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=11468 2018-05-02 06:06:44,041 INFO [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:06:44,049 DEBUG [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:06:44,050 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:06:44,053 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:06:44,066 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:06:44,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:06:47,663 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=02:21.008 minutes, events=11, succcessCount=11, totalEvents=19, totalSuccessCount=19 2018-05-02 06:06:48,874 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:06:48,876 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:06:48,879 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:06:49,384 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:06:49,922 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:06:49,922 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:06:50,033 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:06:50,033 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:06:50,033 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:06:50,041 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:06:50,045 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:06:50,045 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:06:50,663 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=2, succcessCount=1, totalEvents=40, totalSuccessCount=20 2018-05-02 06:07:28,162 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:08:14,950 DEBUG [RS-EventLoopGroup-1-4] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:08:17,939 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:17,944 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:17,956 DEBUG [RS-EventLoopGroup-1-5] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:08:20,958 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:08:20,959 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:08:20,959 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:08:20,961 DEBUG [RS-EventLoopGroup-1-6] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:08:20,966 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:08:21,006 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:08:21,007 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:08:21,010 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:08:21,010 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:08:21,010 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:08:51,287 DEBUG [RS-EventLoopGroup-1-7] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:08:53,033 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:53,035 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:08:54,291 DEBUG [RS-EventLoopGroup-1-8] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:08:57,296 DEBUG [RS-EventLoopGroup-1-9] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:08:57,303 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:08:57,313 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:08:57,314 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:08:57,318 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:08:57,319 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:08:57,319 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:09:32,586 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:09:32,587 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:09:32,587 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:09:32,589 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:09:32,597 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:09:32,597 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:09:32,599 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:09:32,599 DEBUG [RS-EventLoopGroup-1-10] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:09:32,600 DEBUG [RS-EventLoopGroup-1-10] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:09:40,506 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:09:40,508 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:09:40,512 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:09:40,512 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Claimed the leader znode as 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855' 2018-05-02 06:09:40,513 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:09:40,515 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:09:40,527 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 1 2018-05-02 06:09:40,527 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 2 2018-05-02 06:09:40,527 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 3 2018-05-02 06:09:40,527 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 4 2018-05-02 06:09:40,527 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 5 2018-05-02 06:09:40,527 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 6 2018-05-02 06:09:40,527 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 7 2018-05-02 06:09:40,527 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 8 2018-05-02 06:09:40,527 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/7 2018-05-02 06:09:40,529 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Running as master, ignoring new key 7 2018-05-02 06:10:10,670 DEBUG [RS-EventLoopGroup-1-11] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:10:10,673 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:10:10,673 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:10,675 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:10:10,685 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:10,686 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:10:10,687 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:10,687 DEBUG [RS-EventLoopGroup-1-11] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:10:10,687 DEBUG [RS-EventLoopGroup-1-11] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:10:10,692 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:10:10,726 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:10:10,727 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:10:10,727 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => a58d4c86d2df306cc460a231fd5a1ac1, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 06:10:10,727 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => e1d84fe7eb9adbf61fec50c75876bce8, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8.', STARTKEY => 'W\x945\xE5\x0DyCR', ENDKEY => '^P\xD7\x945\xE5\x0Dl'} 2018-05-02 06:10:10,727 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => a3403d29839e289caca7a1e3c5cd71be, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be.', STARTKEY => '/(k\xCA\x1A\xF2\x86\xB6', ENDKEY => '5\xE5\x0DyC^P\xD0'} 2018-05-02 06:10:10,727 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=AuthenticationService 2018-05-02 06:10:10,727 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=AuthenticationService 2018-05-02 06:10:10,728 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=AuthenticationService 2018-05-02 06:10:10,728 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=SecureBulkLoadService 2018-05-02 06:10:10,728 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,728 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,728 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=SecureBulkLoadService 2018-05-02 06:10:10,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=SecureBulkLoadService 2018-05-02 06:10:10,728 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:10:10,728 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,728 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,728 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,728 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,728 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,728 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,728 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => 84e1f06e5813d24f1cc300fb32167710, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710.', STARTKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C', ENDKEY => '/(k\xCA\x1A\xF2\x86\xB6'} 2018-05-02 06:10:10,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=AccessControlService 2018-05-02 06:10:10,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. service=AuthenticationService 2018-05-02 06:10:10,729 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,729 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,729 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. service=SecureBulkLoadService 2018-05-02 06:10:10,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:10:10,729 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,729 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:10:10,730 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,730 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,730 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. service=AccessControlService 2018-05-02 06:10:10,730 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,730 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,730 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,730 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 84e1f06e5813d24f1cc300fb32167710 2018-05-02 06:10:10,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. service=AccessControlService 2018-05-02 06:10:10,728 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. service=AccessControlService 2018-05-02 06:10:10,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:10:10,731 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,731 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,731 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,731 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:10:10,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a3403d29839e289caca7a1e3c5cd71be 2018-05-02 06:10:10,731 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,731 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:10:10,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e1d84fe7eb9adbf61fec50c75876bce8 2018-05-02 06:10:10,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:10:10,733 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => 022c10bc256d7e8dc5d475d7ff8545ea, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:10:10,733 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,733 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,733 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AuthenticationService 2018-05-02 06:10:10,733 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,733 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=SecureBulkLoadService 2018-05-02 06:10:10,733 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,733 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,733 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,733 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AccessControlService 2018-05-02 06:10:10,734 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,734 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,734 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:10:10,734 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:10:10,734 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,736 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:10:10,736 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opening region: {ENCODED => b91e4798ff3d5547c13242b7b77e2f63, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63.', STARTKEY => '\xDEP\xD7\x945\xE5\x0DZ', ENDKEY => '\xE5\x0DyC^P\xD7t'} 2018-05-02 06:10:10,737 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. service=AuthenticationService 2018-05-02 06:10:10,737 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,737 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. service=SecureBulkLoadService 2018-05-02 06:10:10,737 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,737 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,737 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,737 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. service=AccessControlService 2018-05-02 06:10:10,737 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,737 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b91e4798ff3d5547c13242b7b77e2f63 2018-05-02 06:10:10,738 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:10:10,738 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,740 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:10:10,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => 1fa0746104343e63d4a6c982f8a3bf32, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32.', STARTKEY => '!\xAF(k\xCA\x1A\xF2\x82', ENDKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C'} 2018-05-02 06:10:10,741 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:10:10,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=AuthenticationService 2018-05-02 06:10:10,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=SecureBulkLoadService 2018-05-02 06:10:10,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opening region: {ENCODED => cdf5d5c10fe0b7d279387a401c3754ca, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca.', STARTKEY => '\x86\xBC\xA1\xAF(k\xCA\x08', ENDKEY => '\x8DyC^P\xD7\x94"'} 2018-05-02 06:10:10,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=AccessControlService 2018-05-02 06:10:10,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. service=AuthenticationService 2018-05-02 06:10:10,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 1fa0746104343e63d4a6c982f8a3bf32 2018-05-02 06:10:10,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:10:10,742 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:10:10,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. service=SecureBulkLoadService 2018-05-02 06:10:10,742 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:10:10,742 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:10:10,742 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,742 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:10:10,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. service=AccessControlService 2018-05-02 06:10:10,743 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:10:10,743 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:10:10,743 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode cdf5d5c10fe0b7d279387a401c3754ca 2018-05-02 06:10:10,743 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:10:10,744 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:10:10,767 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1 2018-05-02 06:10:10,767 DEBUG [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1 2018-05-02 06:10:10,767 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1 2018-05-02 06:10:10,767 DEBUG [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1 2018-05-02 06:10:10,767 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:10:10,767 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:10:10,767 DEBUG [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/f1 2018-05-02 06:10:10,767 DEBUG [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/f1 2018-05-02 06:10:10,768 INFO [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,768 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,768 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,768 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,769 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,769 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,769 INFO [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,772 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1 2018-05-02 06:10:10,772 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1 2018-05-02 06:10:10,772 INFO [StoreOpener-a3403d29839e289caca7a1e3c5cd71be-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,772 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,772 INFO [StoreOpener-84e1f06e5813d24f1cc300fb32167710-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,773 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,773 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,773 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,773 DEBUG [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/f1 2018-05-02 06:10:10,773 DEBUG [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/f1 2018-05-02 06:10:10,774 INFO [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be 2018-05-02 06:10:10,775 INFO [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,775 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710 2018-05-02 06:10:10,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:10:10,777 INFO [StoreOpener-cdf5d5c10fe0b7d279387a401c3754ca-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,777 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1 2018-05-02 06:10:10,777 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1 2018-05-02 06:10:10,778 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32 2018-05-02 06:10:10,778 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,773 DEBUG [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/f1 2018-05-02 06:10:10,778 DEBUG [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/f1 2018-05-02 06:10:10,778 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,779 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca 2018-05-02 06:10:10,782 INFO [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=2, currentSize=155.91 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=155.91 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:10:10,783 INFO [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:10:10,797 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,801 INFO [StoreOpener-e1d84fe7eb9adbf61fec50c75876bce8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,802 INFO [StoreOpener-b91e4798ff3d5547c13242b7b77e2f63-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:10:10,807 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8 2018-05-02 06:10:10,802 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:10:10,819 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63 2018-05-02 06:10:10,834 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,834 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened 1fa0746104343e63d4a6c982f8a3bf32; next sequenceid=2 2018-05-02 06:10:10,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,838 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened a3403d29839e289caca7a1e3c5cd71be; next sequenceid=2 2018-05-02 06:10:10,839 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,839 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened 022c10bc256d7e8dc5d475d7ff8545ea; next sequenceid=2 2018-05-02 06:10:10,841 INFO [PostOpenDeployTasks:1fa0746104343e63d4a6c982f8a3bf32] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:10:10,843 INFO [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:10:10,843 INFO [PostOpenDeployTasks:a3403d29839e289caca7a1e3c5cd71be] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:10:10,846 DEBUG [PostOpenDeployTasks:1fa0746104343e63d4a6c982f8a3bf32] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:10:10,846 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:10:10,848 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,848 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened e1d84fe7eb9adbf61fec50c75876bce8; next sequenceid=2 2018-05-02 06:10:10,848 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,848 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened 84e1f06e5813d24f1cc300fb32167710; next sequenceid=2 2018-05-02 06:10:10,848 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,848 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opened cdf5d5c10fe0b7d279387a401c3754ca; next sequenceid=2 2018-05-02 06:10:10,849 DEBUG [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:10:10,849 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:10:10,851 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,851 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opened b91e4798ff3d5547c13242b7b77e2f63; next sequenceid=2 2018-05-02 06:10:10,852 DEBUG [PostOpenDeployTasks:a3403d29839e289caca7a1e3c5cd71be] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:10:10,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:10:10,855 INFO [PostOpenDeployTasks:e1d84fe7eb9adbf61fec50c75876bce8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:10:10,855 INFO [PostOpenDeployTasks:cdf5d5c10fe0b7d279387a401c3754ca] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:10:10,855 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/recovered.edits/2.seqid, newMaxSeqId=2, maxSeqId=-1 2018-05-02 06:10:10,855 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened a58d4c86d2df306cc460a231fd5a1ac1; next sequenceid=2 2018-05-02 06:10:10,855 INFO [PostOpenDeployTasks:84e1f06e5813d24f1cc300fb32167710] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:10:10,855 INFO [PostOpenDeployTasks:b91e4798ff3d5547c13242b7b77e2f63] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:10:10,861 DEBUG [PostOpenDeployTasks:e1d84fe7eb9adbf61fec50c75876bce8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:10:10,861 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:10:10,861 DEBUG [PostOpenDeployTasks:cdf5d5c10fe0b7d279387a401c3754ca] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:10:10,862 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:10:10,862 DEBUG [PostOpenDeployTasks:b91e4798ff3d5547c13242b7b77e2f63] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:10:10,862 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:10:10,862 DEBUG [PostOpenDeployTasks:84e1f06e5813d24f1cc300fb32167710] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:10:10,862 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:10:10,865 INFO [PostOpenDeployTasks:a58d4c86d2df306cc460a231fd5a1ac1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:10:10,870 DEBUG [PostOpenDeployTasks:a58d4c86d2df306cc460a231fd5a1ac1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:10:10,870 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:10:14,090 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:10:15,730 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:10:15,731 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:10:15,732 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:10:16,236 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:10:16,593 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:10:16,594 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:10:16,817 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:10:16,817 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:10:16,817 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:10:16,822 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:10:16,824 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:10:16,824 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:10:17,681 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=03:30.017 minutes, events=1, succcessCount=1, totalEvents=20, totalSuccessCount=20 2018-05-02 06:10:45,784 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=155.91 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=2, accesses=5, hits=3, hitRatio=60.00%, , cachingAccesses=5, cachingHits=3, cachingHitsRatio=60.00%, evictions=59, evicted=0, evictedPerRun=0.0 2018-05-02 06:10:50,684 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=2, succcessCount=1, totalEvents=42, totalSuccessCount=21 2018-05-02 06:10:55,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:10:55,118 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:10:55,985 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:10:55,985 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:55,985 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:10:55,988 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:56,039 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:10:56,040 DEBUG [RS-EventLoopGroup-1-12] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:10:56,724 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:10:56,725 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:56,725 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:10:56,727 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:10:56,728 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:10:56,729 DEBUG [RS-EventLoopGroup-1-13] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:11:05,904 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 219 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:11:15,454 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:11:15,454 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:15,455 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:11:15,490 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:15,492 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:11:15,493 DEBUG [RS-EventLoopGroup-1-14] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:11:19,086 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:01.405 minutes, events=7920, succcessCount=7920, totalEvents=7940, totalSuccessCount=7940 2018-05-02 06:11:21,277 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 182 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:11:22,665 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:11:22,665 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:22,666 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:11:22,670 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:11:22,672 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:11:22,672 DEBUG [RS-EventLoopGroup-1-15] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:11:24,372 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 206 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:11:31,423 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 190 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:11:32,442 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 138 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:11:34,232 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 136 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:11:34,232 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 158 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:11:50,896 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.212 minutes, events=115586, succcessCount=36183, totalEvents=115628, totalSuccessCount=36204 2018-05-02 06:11:53,568 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:11:53,570 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:11:53,604 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:11:54,149 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:11:54,545 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 128 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:11:54,591 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:11:54,591 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:11:54,704 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:11:54,704 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:11:54,704 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:11:54,721 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:11:54,730 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:11:54,731 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:11:57,160 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 113 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:11:58,152 INFO [sync.0] wal.AbstractFSWAL: Slow sync cost: 230 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:12:04,971 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 131 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:12:06,101 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 216 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:12:06,101 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 220 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:12:19,617 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:00.532 minutes, events=58585, succcessCount=58585, totalEvents=66525, totalSuccessCount=66525 2018-05-02 06:12:22,456 DEBUG [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 06:12:22,462 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.8 MTotal Memstore Off-Heap size=0, Region memstore size=26.6 M 2018-05-02 06:12:22,464 INFO [MemStoreFlusher.0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:12:22,465 INFO [MemStoreFlusher.0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=12.18 MB memstore heap size=26.65 MB 2018-05-02 06:12:23,505 INFO [MemStoreFlusher.0] regionserver.DefaultStoreFlusher: Flushed memstore data size=12.18 MB at sequenceid=338 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/.tmp/f1/845389644a5e479097fbc8df18727132 2018-05-02 06:12:23,554 DEBUG [MemStoreFlusher.0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/.tmp/f1/845389644a5e479097fbc8df18727132 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/845389644a5e479097fbc8df18727132 2018-05-02 06:12:23,589 INFO [MemStoreFlusher.0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/845389644a5e479097fbc8df18727132, entries=218571, sequenceid=338, filesize=12.0 M 2018-05-02 06:12:23,604 INFO [MemStoreFlusher.0] regionserver.HRegion: Finished memstore flush; data size ~12.18 MB/12775432, heap size ~26.65 MB/27940888, currentsize=77.68 KB/79548 for 022c10bc256d7e8dc5d475d7ff8545ea in 1139ms, sequenceid=338, compaction requested=false 2018-05-02 06:12:28,017 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 120 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.69.22:1019,DS-01906906-e3aa-46c1-8e70-32cda003d733,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:12:34,821 DEBUG [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush thread woke up because memory above low water=204.8 M 2018-05-02 06:12:34,821 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: Flush of region test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. due to global heap pressure. Flush type=ABOVE_ONHEAP_LOWER_MARKTotal Memstore Heap size=204.9 MTotal Memstore Off-Heap size=0, Region memstore size=29.4 M 2018-05-02 06:12:34,822 INFO [MemStoreFlusher.1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:12:34,822 INFO [MemStoreFlusher.1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.42 MB memstore heap size=29.37 MB 2018-05-02 06:12:35,384 INFO [MemStoreFlusher.1] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.42 MB at sequenceid=381 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/.tmp/f1/1b1b3109d73b4cc99883318973d6daff 2018-05-02 06:12:35,443 DEBUG [MemStoreFlusher.1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/.tmp/f1/1b1b3109d73b4cc99883318973d6daff as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/1b1b3109d73b4cc99883318973d6daff 2018-05-02 06:12:35,475 INFO [MemStoreFlusher.1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/1b1b3109d73b4cc99883318973d6daff, entries=240908, sequenceid=381, filesize=13.3 M 2018-05-02 06:12:35,480 INFO [MemStoreFlusher.1] regionserver.HRegion: Finished memstore flush; data size ~13.42 MB/14076282, heap size ~29.37 MB/30796424, currentsize=77.68 KB/79548 for a3403d29839e289caca7a1e3c5cd71be in 658ms, sequenceid=381, compaction requested=false 2018-05-02 06:12:49,177 DEBUG [RS-EventLoopGroup-1-16] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:12:49,179 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:12:49,179 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 636 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:49,181 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:12:49,183 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:49,184 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:12:49,185 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:12:49,185 DEBUG [RS-EventLoopGroup-1-16] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hrt_qa@EXAMPLE.COM 2018-05-02 06:12:49,186 DEBUG [RS-EventLoopGroup-1-16] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:12:52,705 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:01.809 minutes, events=634196, succcessCount=42902, totalEvents=749824, totalSuccessCount=79106 2018-05-02 06:14:17,705 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:17,705 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:17,706 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:17,708 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:17,709 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:17,710 DEBUG [RS-EventLoopGroup-1-17] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:18,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1363785 bytes) of f1 2018-05-02 06:14:22,713 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=02:03.096 minutes, events=12581, succcessCount=12581, totalEvents=79106, totalSuccessCount=79106 2018-05-02 06:14:28,244 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:28,245 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:28,245 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:28,247 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:28,248 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:28,249 DEBUG [RS-EventLoopGroup-1-18] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:28,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1363995 bytes) of f1 2018-05-02 06:14:49,506 DEBUG [RS-EventLoopGroup-1-19] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:14:49,507 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:14:49,507 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:49,514 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:14:49,515 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:49,515 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:14:49,516 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:49,516 DEBUG [RS-EventLoopGroup-1-19] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:14:49,520 DEBUG [RS-EventLoopGroup-1-19] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:14:49,522 INFO [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:14:49,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 06:14:49,551 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 06:14:49,552 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:14:49,552 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 06:14:49,552 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:14:49,552 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:14:49,552 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:14:49,552 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 06:14:49,553 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:14:49,553 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:14:49,553 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 06:14:49,553 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:14:49,554 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:14:49,574 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 06:14:49,574 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 06:14:49,576 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=407, currentSize=25.66 MB, freeSize=179.14 MB, maxSize=204.80 MB, heapSize=25.66 MB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:14:49,576 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:14:49,616 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 06:14:49,619 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:14:49,626 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 06:14:49,646 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12075.seqid, newMaxSeqId=12075, maxSeqId=12074 2018-05-02 06:14:49,659 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=12075 2018-05-02 06:14:49,665 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:14:49,669 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:14:49,669 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:14:51,744 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:51,744 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:51,744 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:51,746 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:51,748 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:51,748 DEBUG [RS-EventLoopGroup-1-20] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:52,020 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:14:52,020 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:52,020 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:14:52,023 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:14:52,024 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:14:52,025 DEBUG [RS-EventLoopGroup-1-21] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:14:52,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=26,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454895 bytes) of f1 2018-05-02 06:14:52,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454850 bytes) of f1 2018-05-02 06:14:52,720 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.013 minutes, events=6, succcessCount=3, totalEvents=749830, totalSuccessCount=79109 2018-05-02 06:14:54,554 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:14:54,555 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:14:54,562 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:14:55,069 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:14:55,471 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:14:55,471 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:14:55,662 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:14:55,662 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:14:55,662 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:14:55,754 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:14:55,760 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:14:55,760 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:15:00,421 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2." 2018-05-02 06:15:00,422 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close aa977fc80ff408457e9257d2ab7afdf2, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281. Requested from /172.27.61.83 2018-05-02 06:15:00,441 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:15:00,441 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing aa977fc80ff408457e9257d2ab7afdf2, disabling compactions & flushes 2018-05-02 06:15:00,441 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:15:00,450 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059." 2018-05-02 06:15:00,450 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 29fe0b7866912efc70bb3f2d7fd83059, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892. Requested from /172.27.61.83 2018-05-02 06:15:00,451 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:15:00,451 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 29fe0b7866912efc70bb3f2d7fd83059, disabling compactions & flushes 2018-05-02 06:15:00,451 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:15:00,476 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/aa977fc80ff408457e9257d2ab7afdf2/recovered.edits/12536.seqid, newMaxSeqId=12536, maxSeqId=12534 2018-05-02 06:15:00,487 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:15:00,487 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:15:00,487 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:15:00,487 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:15:00,487 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding aa977fc80ff408457e9257d2ab7afdf2 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 record at close sequenceid=12534 2018-05-02 06:15:00,488 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12757.seqid, newMaxSeqId=12757, maxSeqId=12755 2018-05-02 06:15:00,491 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3d70a3d2,1525237868269.aa977fc80ff408457e9257d2ab7afdf2. 2018-05-02 06:15:00,496 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:15:00,496 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:15:00,496 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:15:00,496 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:15:00,496 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 29fe0b7866912efc70bb3f2d7fd83059 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 record at close sequenceid=12755 2018-05-02 06:15:00,500 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:15:00,744 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\353\312\032\362\206\274\241\216,1525239890069.b52f5cecdefd18652f3e796b8dada29f." 2018-05-02 06:15:00,744 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close b52f5cecdefd18652f3e796b8dada29f, moving to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391. Requested from /172.27.61.83 2018-05-02 06:15:00,744 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11." 2018-05-02 06:15:00,745 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close b5180eee96b616afdf79578309c66a11, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281. Requested from /172.27.61.83 2018-05-02 06:15:00,745 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:15:00,745 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing b52f5cecdefd18652f3e796b8dada29f, disabling compactions & flushes 2018-05-02 06:15:00,745 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:15:00,745 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:15:00,745 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 06:15:00,745 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:15:00,774 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:15:00,778 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12159.seqid, newMaxSeqId=12159, maxSeqId=12157 2018-05-02 06:15:00,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:15:00,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:15:00,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:15:00,785 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:15:00,785 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding b52f5cecdefd18652f3e796b8dada29f move to ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 record at close sequenceid=408 2018-05-02 06:15:00,788 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:15:00,795 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:15:00,795 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:15:00,795 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:15:00,795 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:15:00,795 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding b5180eee96b616afdf79578309c66a11 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 record at close sequenceid=12157 2018-05-02 06:15:00,798 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:15:01,563 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6." 2018-05-02 06:15:01,563 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 735f841820ff0baa687bc402b169f4a6, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281. Requested from /172.27.61.83 2018-05-02 06:15:01,566 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:15:01,566 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 735f841820ff0baa687bc402b169f4a6, disabling compactions & flushes 2018-05-02 06:15:01,566 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:15:01,586 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12239.seqid, newMaxSeqId=12239, maxSeqId=12237 2018-05-02 06:15:01,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:15:01,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:15:01,591 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:15:01,591 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:15:01,591 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 735f841820ff0baa687bc402b169f4a6 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 record at close sequenceid=12237 2018-05-02 06:15:01,594 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:15:04,484 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:04,484 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:04,484 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:04,486 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:04,488 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:04,488 DEBUG [RS-EventLoopGroup-1-22] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:05,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454910 bytes) of f1 2018-05-02 06:15:05,487 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:15:05,491 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:15:05,491 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:15:06,000 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:15:07,862 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:15:07,862 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:15:07,962 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:15:07,962 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:15:07,962 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:15:07,972 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:15:07,994 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:15:07,995 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:15:14,525 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:14,525 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:14,525 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:14,527 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:14,529 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:14,529 DEBUG [RS-EventLoopGroup-1-23] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:14,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454910 bytes) of f1 2018-05-02 06:15:45,784 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=25.66 MB, freeSize=179.14 MB, max=204.80 MB, blockCount=407, accesses=412, hits=5, hitRatio=1.21%, , cachingAccesses=412, cachingHits=5, cachingHitsRatio=1.21%, evictions=89, evicted=0, evictedPerRun=0.0 2018-05-02 06:15:52,776 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.056 minutes, events=26, succcessCount=13, totalEvents=749856, totalSuccessCount=79122 2018-05-02 06:15:55,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=6, created chunk count=51, reused chunk count=8, reuseRatio=13.56% 2018-05-02 06:15:55,118 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:15:59,123 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:59,123 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:59,124 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:59,127 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:59,128 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:59,129 DEBUG [RS-EventLoopGroup-1-24] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:59,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454955 bytes) of f1 2018-05-02 06:15:59,559 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Created SASL server with mechanism = DIGEST-MD5 2018-05-02 06:15:59,559 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:59,559 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Will send token of size 149 from saslServer. 2018-05-02 06:15:59,560 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Have read input token of size 321 for processing by saslServer.evaluateResponse() 2018-05-02 06:15:59,562 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: Will send token of size 40 from saslServer. 2018-05-02 06:15:59,562 DEBUG [RS-EventLoopGroup-1-25] ipc.RpcServer: SASL server context established. Authenticated client: hrt_qa@EXAMPLE.COM (auth:TOKEN). Negotiated QoP is auth-conf 2018-05-02 06:15:59,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.StoreScanner: Switch to stream read (scanned=1454895 bytes) of f1 2018-05-02 06:16:01,776 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:39.063 minutes, events=16, succcessCount=16, totalEvents=79122, totalSuccessCount=79122 2018-05-02 06:16:52,787 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.011 minutes, events=4, succcessCount=2, totalEvents=749860, totalSuccessCount=79124 2018-05-02 06:16:53,352 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:16:53,353 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:16:53,355 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:16:53,859 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:16:54,145 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:16:54,145 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:16:54,216 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:16:54,216 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:16:54,216 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:16:54,221 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:16:54,222 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:16:54,223 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:19:30,080 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:19:30,082 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 1 failover attempts. Trying to failover after sleeping for 1183ms. 2018-05-02 06:19:31,268 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 2 failover attempts. Trying to failover after sleeping for 1424ms. 2018-05-02 06:19:32,694 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 3 failover attempts. Trying to failover after sleeping for 3664ms. 2018-05-02 06:19:36,361 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 4 failover attempts. Trying to failover after sleeping for 11857ms. 2018-05-02 06:19:48,220 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 5 failover attempts. Trying to failover after sleeping for 20195ms. 2018-05-02 06:20:08,418 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 6 failover attempts. Trying to failover after sleeping for 14081ms. 2018-05-02 06:20:22,502 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000003.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 7 failover attempts. Trying to failover after sleeping for 16738ms. 2018-05-02 06:20:39,243 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: java.net.ConnectException: Call From ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95 to ctr-e138-1518143905142-279227-01-000005.hwx.site:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused, while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020 after 8 failover attempts. Trying to failover after sleeping for 8464ms. 2018-05-02 06:20:45,784 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=25.66 MB, freeSize=179.14 MB, max=204.80 MB, blockCount=407, accesses=412, hits=5, hitRatio=1.21%, , cachingAccesses=412, cachingHits=5, cachingHitsRatio=1.21%, evictions=119, evicted=0, evictedPerRun=0.0 2018-05-02 06:20:47,744 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-668040094_1. Name node is in safe mode. The reported blocks 0 needs additional 484 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-668040094_1. Name node is in safe mode. The reported blocks 0 needs additional 484 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 13703ms. 2018-05-02 06:20:55,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=6, created chunk count=51, reused chunk count=8, reuseRatio=13.56% 2018-05-02 06:20:55,118 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:21:01,453 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-668040094_1. Name node is in safe mode. The reported blocks 261 needs additional 223 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-668040094_1. Name node is in safe mode. The reported blocks 261 needs additional 223 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 12956ms. 2018-05-02 06:21:14,414 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-668040094_1. Name node is in safe mode. The reported blocks 388 needs additional 96 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-668040094_1. Name node is in safe mode. The reported blocks 388 needs additional 96 blocks to reach the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 9189ms. 2018-05-02 06:21:23,608 INFO [LeaseRenewer:hbase@mycluster] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RetriableException): org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-668040094_1. Name node is in safe mode. The reported blocks 484 has reached the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 0 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1441) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.renewLease(FSNamesystem.java:3741) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.renewLease(NameNodeRpcServer.java:1134) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.renewLease(ClientNamenodeProtocolServerSideTranslatorPB.java:735) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) Caused by: org.apache.hadoop.hdfs.server.namenode.SafeModeException: Cannot renew lease for DFSClient_NONMAPREDUCE_-668040094_1. Name node is in safe mode. The reported blocks 484 has reached the threshold 1.0000 of total blocks 484. The number of live datanodes 6 has reached the minimum number 0. In safe mode extension. Safe mode will be turned off automatically in 0 seconds. NamenodeHostName:ctr-e138-1518143905142-279227-01-000003.hwx.site at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.newSafemodeException(FSNamesystem.java:1450) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkNameNodeSafeMode(FSNamesystem.java:1437) ... 12 more , while invoking ClientNamenodeProtocolTranslatorPB.renewLease over ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:8020 after 9 failover attempts. Retrying after sleeping for 22337ms. 2018-05-02 06:21:53,351 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:21:53,352 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:21:53,354 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:21:53,866 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:21:54,113 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:21:54,114 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:21:54,211 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:21:54,211 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:21:54,211 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:21:54,218 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:21:54,220 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:21:54,220 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started Wed May 2 06:23:49 UTC 2018 Terminating regionserver 2018-05-02 06:23:49,972 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:23:49,972 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:23:49,972 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:23:49,972 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:23:49,973 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:23:49,973 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:23:49,973 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:23:49,973 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:23:49,974 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:23:49,975 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:23:49,975 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:23:49,975 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:23:49,975 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=07:48.199 minutes, events=2, succcessCount=2, totalEvents=79124, totalSuccessCount=79124 2018-05-02 06:23:49,975 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:23:49,975 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:23:49,976 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 4 milli seconds 2018-05-02 06:23:49,976 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:23:49,976 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:23:49,976 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:23:49,976 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:23:49,978 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:23:49,979 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855' ***** 2018-05-02 06:23:49,980 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:49,982 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:49,982 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:23:49,982 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:23:49,982 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:23:49,987 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:23:49,987 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 exiting 2018-05-02 06:23:50,007 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:23:50,016 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:23:50,017 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:23:50,017 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:23:50,024 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:23:50,025 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:23:50,031 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:23:50,032 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:23:50,032 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:23:50,033 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,034 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,034 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 40744bb706fe10eab3c8964d0c6b003e, disabling compactions & flushes 2018-05-02 06:23:50,034 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:23:50,035 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,036 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,036 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 06:23:50,036 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:23:50,036 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,037 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,037 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 2fd8c4d5abf9928da8e8c547a0ca223a, disabling compactions & flushes 2018-05-02 06:23:50,037 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:23:50,037 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,037 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,037 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,038 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,038 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,038 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,038 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,042 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,043 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,043 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,043 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,044 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,044 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,044 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,044 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,045 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,077 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,077 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,077 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,113 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,113 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,113 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,114 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,114 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,114 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:23:50,114 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:23:50,115 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x004aba65 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:23:50,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:23:50,115 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 27 regions to close 2018-05-02 06:23:50,122 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:23:50,126 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12320.seqid, newMaxSeqId=12320, maxSeqId=12318 2018-05-02 06:23:50,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,134 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:23:50,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,134 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:23:50,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:23:50,134 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:23:50,135 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,135 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing a58d4c86d2df306cc460a231fd5a1ac1, disabling compactions & flushes 2018-05-02 06:23:50,135 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Running close preflush of {}a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:23:50,135 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.91 MB memstore heap size=30.42 MB 2018-05-02 06:23:50,135 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 93f2d602c0a0a654856fb16863c2ff38, disabling compactions & flushes 2018-05-02 06:23:50,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:23:50,154 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12773.seqid, newMaxSeqId=12773, maxSeqId=12771 2018-05-02 06:23:50,161 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,161 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,161 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,161 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:23:50,162 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:23:50,162 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,162 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing a97e624ee736c77fbc6ccefb3abbac31, disabling compactions & flushes 2018-05-02 06:23:50,162 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:23:50,196 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:23:50,196 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:23:50,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,202 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:23:50,202 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,202 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:23:50,203 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:23:50,203 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:23:50,203 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,203 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,204 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 022c10bc256d7e8dc5d475d7ff8545ea, disabling compactions & flushes 2018-05-02 06:23:50,204 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:23:50,204 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 682775c01c8d957d744ae2b280c815cd, disabling compactions & flushes 2018-05-02 06:23:50,204 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:23:50,204 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=2.40 MB memstore heap size=5.24 MB 2018-05-02 06:23:50,241 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/recovered.edits/12501.seqid, newMaxSeqId=12501, maxSeqId=12499 2018-05-02 06:23:50,246 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,246 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,247 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,247 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:23:50,247 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:23:50,247 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,247 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 3bbeffd33dfc99ea8862c8eae819df62, disabling compactions & flushes 2018-05-02 06:23:50,247 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:23:50,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12464.seqid, newMaxSeqId=12464, maxSeqId=12462 2018-05-02 06:23:50,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,282 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:23:50,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:23:50,282 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,283 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 84c55bda386b9aa62a8b4df75ca9b38c, disabling compactions & flushes 2018-05-02 06:23:50,283 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:23:50,325 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11883.seqid, newMaxSeqId=11883, maxSeqId=11881 2018-05-02 06:23:50,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,335 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:23:50,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:23:50,335 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,335 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 3f499471b0415a38ad5efe046913cba2, disabling compactions & flushes 2018-05-02 06:23:50,336 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:23:50,372 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=2.40 MB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/.tmp/f1/58da7717f6144f42a435d0770d1a1079 2018-05-02 06:23:50,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:23:50,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,380 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:23:50,380 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:23:50,381 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,381 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 84e1f06e5813d24f1cc300fb32167710, disabling compactions & flushes 2018-05-02 06:23:50,381 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Running close preflush of {}84e1f06e5813d24f1cc300fb32167710 2018-05-02 06:23:50,381 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.99 MB memstore heap size=30.62 MB 2018-05-02 06:23:50,451 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] retry.RetryInvocationHandler: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.StandbyException): Operation category READ is not supported in state standby. Visit https://s.apache.org/sbnn-error at org.apache.hadoop.hdfs.server.namenode.ha.StandbyState.checkOperation(StandbyState.java:88) at org.apache.hadoop.hdfs.server.namenode.NameNode$NameNodeHAContext.checkOperation(NameNode.java:1952) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.checkOperation(FSNamesystem.java:1423) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1921) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:738) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:424) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:523) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:991) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:872) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:818) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2678) , while invoking ClientNamenodeProtocolTranslatorPB.getBlockLocations over ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:8020. Trying to failover immediately. 2018-05-02 06:23:50,462 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/.tmp/f1/58da7717f6144f42a435d0770d1a1079 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/58da7717f6144f42a435d0770d1a1079 2018-05-02 06:23:50,519 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/58da7717f6144f42a435d0770d1a1079, entries=42982, sequenceid=407, filesize=2.4 M 2018-05-02 06:23:50,523 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Finished memstore flush; data size ~2.40 MB/2511444, heap size ~5.24 MB/5494840, currentsize=0 B/0 for 022c10bc256d7e8dc5d475d7ff8545ea in 318ms, sequenceid=407, compaction requested=false 2018-05-02 06:23:50,560 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:23:50,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,567 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:23:50,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:23:50,568 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing f3ccd3e0671152671071dbba3e2cb560, disabling compactions & flushes 2018-05-02 06:23:50,576 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:23:50,615 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12796.seqid, newMaxSeqId=12796, maxSeqId=12794 2018-05-02 06:23:50,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,630 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,630 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,630 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:23:50,630 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:23:50,630 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 60955ebb25dcf0aeb6d46e894a921538, disabling compactions & flushes 2018-05-02 06:23:50,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:23:50,700 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/33.seqid, newMaxSeqId=33, maxSeqId=31 2018-05-02 06:23:50,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,710 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:23:50,710 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:23:50,710 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,710 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 843b3b66a19c1c2d494720e99edc9c52, disabling compactions & flushes 2018-05-02 06:23:50,710 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:23:50,744 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:23:50,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:50,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:50,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:50,751 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:23:50,751 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:23:50,751 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:50,751 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing a3403d29839e289caca7a1e3c5cd71be, disabling compactions & flushes 2018-05-02 06:23:50,751 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:23:50,752 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=893.36 KB memstore heap size=1.91 MB 2018-05-02 06:23:50,858 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=893.36 KB at sequenceid=407 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/.tmp/f1/e948a42d644f4854aaf007ff04010533 2018-05-02 06:23:50,897 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/.tmp/f1/e948a42d644f4854aaf007ff04010533 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/e948a42d644f4854aaf007ff04010533 2018-05-02 06:23:50,930 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/f1/e948a42d644f4854aaf007ff04010533, entries=15631, sequenceid=407, filesize=902.4 K 2018-05-02 06:23:50,932 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Finished memstore flush; data size ~893.36 KB/914802, heap size ~1.91 MB/1998408, currentsize=0 B/0 for a3403d29839e289caca7a1e3c5cd71be in 181ms, sequenceid=407, compaction requested=false 2018-05-02 06:23:51,099 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a3403d29839e289caca7a1e3c5cd71be/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=2 2018-05-02 06:23:51,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:51,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:51,105 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:51,106 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:23:51,106 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,/(k\xCA\x1A\xF2\x86\xB6,1525241408832.a3403d29839e289caca7a1e3c5cd71be. 2018-05-02 06:23:51,107 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:51,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 06:23:51,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:23:51,119 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 13 regions to close 2018-05-02 06:23:51,140 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11470.seqid, newMaxSeqId=11470, maxSeqId=11468 2018-05-02 06:23:51,146 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:51,147 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:51,147 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:51,147 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:23:51,147 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:23:51,147 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:51,148 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing e1d84fe7eb9adbf61fec50c75876bce8, disabling compactions & flushes 2018-05-02 06:23:51,148 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Running close preflush of {}e1d84fe7eb9adbf61fec50c75876bce8 2018-05-02 06:23:51,149 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.91 MB memstore heap size=30.46 MB 2018-05-02 06:23:51,171 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.91 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/.tmp/f1/01f9f6a5501f41208ca4e0b19e9e7c04 2018-05-02 06:23:51,206 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/.tmp/f1/01f9f6a5501f41208ca4e0b19e9e7c04 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1/01f9f6a5501f41208ca4e0b19e9e7c04 2018-05-02 06:23:51,268 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1/01f9f6a5501f41208ca4e0b19e9e7c04, entries=249509, sequenceid=404, filesize=13.8 M 2018-05-02 06:23:51,272 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Finished memstore flush; data size ~13.91 MB/14582308, heap size ~30.42 MB/31895864, currentsize=0 B/0 for a58d4c86d2df306cc460a231fd5a1ac1 in 1137ms, sequenceid=404, compaction requested=false 2018-05-02 06:23:51,272 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:23:51,321 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:23:51,329 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:51,329 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:51,329 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:51,329 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:23:51,329 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:23:51,329 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:51,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 084aa7d8a3bd4d7483494d5a2c39d5df, disabling compactions & flushes 2018-05-02 06:23:51,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:23:51,357 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.99 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/.tmp/f1/55f6b92d148746a78237d661d14075ef 2018-05-02 06:23:51,390 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12598.seqid, newMaxSeqId=12598, maxSeqId=12596 2018-05-02 06:23:51,396 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:51,396 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:51,397 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:51,397 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:23:51,397 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:23:51,397 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:51,397 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing cdf5d5c10fe0b7d279387a401c3754ca, disabling compactions & flushes 2018-05-02 06:23:51,397 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Running close preflush of {}cdf5d5c10fe0b7d279387a401c3754ca 2018-05-02 06:23:51,398 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.92 MB memstore heap size=30.46 MB 2018-05-02 06:23:51,422 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/.tmp/f1/55f6b92d148746a78237d661d14075ef as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/f1/55f6b92d148746a78237d661d14075ef 2018-05-02 06:23:51,504 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/f1/55f6b92d148746a78237d661d14075ef, entries=251190, sequenceid=404, filesize=13.9 M 2018-05-02 06:23:51,512 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Finished memstore flush; data size ~13.99 MB/14673220, heap size ~30.62 MB/32110776, currentsize=0 B/0 for 84e1f06e5813d24f1cc300fb32167710 in 1131ms, sequenceid=404, compaction requested=false 2018-05-02 06:23:51,512 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:23:51,569 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/84e1f06e5813d24f1cc300fb32167710/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:23:51,582 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:51,582 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:51,582 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:51,582 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:23:51,582 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,(k\xCA\x1A\xF2\x86\xBC\x9C,1525241408832.84e1f06e5813d24f1cc300fb32167710. 2018-05-02 06:23:51,583 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:51,583 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 06:23:51,583 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:23:51,626 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12077.seqid, newMaxSeqId=12077, maxSeqId=12075 2018-05-02 06:23:51,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:51,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:51,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:51,631 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:23:51,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:23:51,632 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:51,632 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing f61045f3bb8866c33d9b05635d777d75, disabling compactions & flushes 2018-05-02 06:23:51,632 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:23:51,668 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:23:51,674 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:51,674 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:51,674 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:51,674 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:23:51,675 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:23:51,675 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:51,675 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 1fa0746104343e63d4a6c982f8a3bf32, disabling compactions & flushes 2018-05-02 06:23:51,675 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Running close preflush of {}1fa0746104343e63d4a6c982f8a3bf32 2018-05-02 06:23:51,675 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.98 MB memstore heap size=30.58 MB 2018-05-02 06:23:51,692 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.91 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/.tmp/f1/f16708f1c3ad4ecc9898112fc1b25f50 2018-05-02 06:23:51,721 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/.tmp/f1/f16708f1c3ad4ecc9898112fc1b25f50 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1/f16708f1c3ad4ecc9898112fc1b25f50 2018-05-02 06:23:51,750 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/f1/f16708f1c3ad4ecc9898112fc1b25f50, entries=249827, sequenceid=404, filesize=13.8 M 2018-05-02 06:23:51,754 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Finished memstore flush; data size ~13.91 MB/14582308, heap size ~30.46 MB/31936568, currentsize=0 B/0 for e1d84fe7eb9adbf61fec50c75876bce8 in 606ms, sequenceid=404, compaction requested=false 2018-05-02 06:23:51,754 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:23:51,828 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e1d84fe7eb9adbf61fec50c75876bce8/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:23:51,835 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:51,835 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:51,835 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:51,835 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:23:51,836 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,W\x945\xE5\x0DyCR,1525241408832.e1d84fe7eb9adbf61fec50c75876bce8. 2018-05-02 06:23:51,836 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:51,836 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 06:23:51,836 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:23:51,884 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/12997.seqid, newMaxSeqId=12997, maxSeqId=12995 2018-05-02 06:23:51,889 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:51,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:51,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:51,890 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:23:51,890 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:23:51,891 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:51,891 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing b91e4798ff3d5547c13242b7b77e2f63, disabling compactions & flushes 2018-05-02 06:23:51,891 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Running close preflush of {}b91e4798ff3d5547c13242b7b77e2f63 2018-05-02 06:23:51,891 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Flushing 1/1 column families, memstore data size=13.92 MB memstore heap size=30.46 MB 2018-05-02 06:23:52,121 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 5 regions to close 2018-05-02 06:23:52,122 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Online Regions={cdf5d5c10fe0b7d279387a401c3754ca=test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca., 1fa0746104343e63d4a6c982f8a3bf32=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32., b91e4798ff3d5547c13242b7b77e2f63=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63., 2e8da78a5421f95de8c75e0053e1d4a0=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0., 5fc7cfd582bc270c530fe9787011078c=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c.} 2018-05-02 06:23:52,316 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.92 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/.tmp/f1/4ad7c958e814455ea328234413e3e47e 2018-05-02 06:23:52,345 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/.tmp/f1/4ad7c958e814455ea328234413e3e47e as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/f1/4ad7c958e814455ea328234413e3e47e 2018-05-02 06:23:52,384 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/f1/4ad7c958e814455ea328234413e3e47e, entries=249861, sequenceid=404, filesize=13.8 M 2018-05-02 06:23:52,390 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Finished memstore flush; data size ~13.92 MB/14593672, heap size ~30.46 MB/31940888, currentsize=0 B/0 for cdf5d5c10fe0b7d279387a401c3754ca in 993ms, sequenceid=404, compaction requested=false 2018-05-02 06:23:52,390 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:23:52,454 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/cdf5d5c10fe0b7d279387a401c3754ca/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:23:52,467 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:52,467 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:52,467 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:52,468 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:23:52,468 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x86\xBC\xA1\xAF(k\xCA\x08,1525241408832.cdf5d5c10fe0b7d279387a401c3754ca. 2018-05-02 06:23:52,468 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:52,468 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 2e8da78a5421f95de8c75e0053e1d4a0, disabling compactions & flushes 2018-05-02 06:23:52,468 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:23:52,507 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:23:52,527 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:52,527 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:52,527 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:52,527 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:23:52,527 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:23:52,527 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:23:52,528 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 5fc7cfd582bc270c530fe9787011078c, disabling compactions & flushes 2018-05-02 06:23:52,528 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:23:52,618 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:23:52,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:52,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:52,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:52,630 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:23:52,630 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:23:52,957 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.98 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/.tmp/f1/d53deff6e1564e7f9a4b4dcf2158aa82 2018-05-02 06:23:52,984 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/.tmp/f1/d53deff6e1564e7f9a4b4dcf2158aa82 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1/d53deff6e1564e7f9a4b4dcf2158aa82 2018-05-02 06:23:53,028 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1/d53deff6e1564e7f9a4b4dcf2158aa82, entries=250816, sequenceid=404, filesize=13.8 M 2018-05-02 06:23:53,035 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Finished memstore flush; data size ~13.98 MB/14661856, heap size ~30.58 MB/32062936, currentsize=0 B/0 for 1fa0746104343e63d4a6c982f8a3bf32 in 1360ms, sequenceid=404, compaction requested=false 2018-05-02 06:23:53,035 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:23:53,058 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.DefaultStoreFlusher: Flushed memstore data size=13.92 MB at sequenceid=404 (bloomFilter=true), to=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/.tmp/f1/5c55ea585a374e61ae2ef341de1c0c88 2018-05-02 06:23:53,185 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 2 regions to close 2018-05-02 06:23:53,185 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Online Regions={1fa0746104343e63d4a6c982f8a3bf32=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32., b91e4798ff3d5547c13242b7b77e2f63=test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63.} 2018-05-02 06:23:53,192 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:23:53,197 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:53,197 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:53,197 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:53,197 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:23:53,197 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:23:53,207 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/.tmp/f1/5c55ea585a374e61ae2ef341de1c0c88 as hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/f1/5c55ea585a374e61ae2ef341de1c0c88 2018-05-02 06:23:53,248 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/f1/5c55ea585a374e61ae2ef341de1c0c88, entries=249848, sequenceid=404, filesize=13.8 M 2018-05-02 06:23:53,251 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Finished memstore flush; data size ~13.92 MB/14593672, heap size ~30.46 MB/31939224, currentsize=0 B/0 for b91e4798ff3d5547c13242b7b77e2f63 in 1360ms, sequenceid=404, compaction requested=false 2018-05-02 06:23:53,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:23:53,284 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b91e4798ff3d5547c13242b7b77e2f63/recovered.edits/407.seqid, newMaxSeqId=407, maxSeqId=2 2018-05-02 06:23:53,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:23:53,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:23:53,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:23:53,290 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:23:53,291 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xDEP\xD7\x945\xE5\x0DZ,1525241408832.b91e4798ff3d5547c13242b7b77e2f63. 2018-05-02 06:23:53,385 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855; all regions closed. 2018-05-02 06:23:53,385 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:23:53,427 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:23:53,427 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525240839855:(num 1525240858356) 2018-05-02 06:23:53,427 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:23:53,428 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Leases: Closed leases 2018-05-02 06:23:53,430 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 had [[ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS], [ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 Period: 120000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:23:53,430 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:23:53,430 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:23:53,430 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:23:53,430 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:23:53,437 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.NettyRpcServer: Stopping server on /172.27.70.95:16020 2018-05-02 06:23:53,438 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ZKLeaderManager: Stepping down as leader 2018-05-02 06:23:53,441 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:23:53,441 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:23:53,441 DEBUG [ZKSecretWatcher-leaderElector] token.AuthenticationTokenSecretManager: Interrupted waiting for next update java.lang.InterruptedException: sleep interrupted at java.lang.Thread.sleep(Native Method) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:351) 2018-05-02 06:23:53,449 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:23:53,455 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:23:53,455 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:23:53,455 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:23:53,455 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:23:53,455 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:23:53,455 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:23:53,455 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:23:53,455 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:23:53,455 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:23:53,455 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/8 2018-05-02 06:23:53,457 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:23:53,486 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855 2018-05-02 06:23:53,487 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c00ee, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:23:53,506 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:23:53,507 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ZooKeeper: Session: 0x1631f08b26c00ee closed 2018-05-02 06:23:53,507 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855; zookeeper connection closed. 2018-05-02 06:23:53,507 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:23:53,516 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:24:15 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000002.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1031588 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:24:18,289 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:24:18,293 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:24:18,293 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:24:18,293 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:24:18,293 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:24:18,923 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:24:18,923 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:24:18,923 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:24:18,923 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:24:18,924 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:24:18,925 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:24:18,926 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:24:18,926 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:24:18,926 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:24:18,926 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:24:18,926 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:24:18,926 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:24:18,926 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:24:18,926 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:24:18,926 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:24:18,926 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020624 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:24:18,927 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:24:18,927 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:24:18,927 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:24:18,927 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log 2018-05-02 06:24:18,927 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:24:18,927 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:24:18,927 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:24:18,927 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:24:18,927 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=409596 2018-05-02 06:24:18,927 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:24:18,928 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:24:18,928 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:24:18,928 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:24:18,928 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:24:18,928 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:24:18,928 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:24:18,928 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:24:18,929 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:24:18,930 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020624 2018-05-02 06:24:18,930 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:24:18,930 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:24:18,930 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:24:18,930 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:24:18,930 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:24:18,930 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:24:18,930 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:24:18,930 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:24:18,930 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:24:18,933 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:24:18,934 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020624, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:24:19,205 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:24:19,802 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:24:19,888 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:24:20,558 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:24:20,565 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:24:21,233 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:24:21,234 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:24:21,234 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:24:21,407 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:24:21,621 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:24:21,621 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:24:21,675 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:24:22,268 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 server-side Connection retries=105 2018-05-02 06:24:22,304 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:24:22,308 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:24:22,309 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:24:22,309 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:24:22,309 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:24:22,310 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:24:22,531 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:24:22,876 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:24:22,906 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:24:23,068 INFO [main] ipc.NettyRpcServer: Bind to /172.27.70.95:16020 2018-05-02 06:24:23,344 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:24:23,347 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:24:23,349 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:24:23,361 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:23,365 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:23,371 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:24:25,387 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:24:25,414 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:24:25,542 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:24:25,555 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:24:25,555 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:24:25,555 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:24:25,555 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:24:25,555 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:24:25,555 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:24:25,557 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:24:25,557 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:24:25,557 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:24:25,557 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:24:25,557 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:24:25,557 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=4.15.12-1.el7.elrepo.x86_64 2018-05-02 06:24:25,557 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:24:25,557 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:24:25,557 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:24:25,559 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:24:25,602 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:24:25,607 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:24:25,613 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:24:25,623 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:24:25,626 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:24:25 UTC 2018 2018-05-02 06:24:25,626 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:24:25 UTC 2018 2018-05-02 06:24:25,626 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 02:20:34 UTC 2018 2018-05-02 06:24:25,636 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:24:25,647 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900bb, negotiated timeout = 90000 2018-05-02 06:24:25,651 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:24:25,652 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb connected 2018-05-02 06:24:25,689 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:24:25,785 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:24:25,785 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:24:25,785 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:24:25,785 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:24:25,785 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:24:25,785 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:24:25,785 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:24:25,785 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:24:25,785 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:24:25,791 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:25,849 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:24:25,860 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:24:25,861 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:24:25,876 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:24:25,891 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:24:26,049 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:24:26,050 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:24:26,050 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:24:26,088 INFO [main] util.log: Logging initialized @9127ms 2018-05-02 06:24:26,212 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:24:26,235 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:24:26,236 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:24:26,240 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:24:26,240 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:24:26,240 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:24:26,293 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:24:26,296 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:24:26,373 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:24:26,373 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:24:26,602 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:24:26,608 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000002.hwx.site,h=[ctr-e138-1518143905142-279227-01-000002.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:24:26,623 INFO [main] server.AbstractConnector: Started ServerConnector@7a4cf5f3{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:24:26,623 INFO [main] server.Server: Started @9662ms 2018-05-02 06:24:26,650 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:24:26,655 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:24:26,672 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:24:26,672 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:24:26,677 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:24:26,719 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Connect 0x557c7f56 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:24:26,733 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x557c7f56] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/887427401@71e799b1 2018-05-02 06:24:26,734 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x557c7f56-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:24:26,735 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x557c7f56-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:24:26,736 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x557c7f56-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 06:24:26,740 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x557c7f56-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d93900c0, negotiated timeout = 90000 2018-05-02 06:24:26,794 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d04a5ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:24:26,797 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ba4cece, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:0 2018-05-02 06:24:26,806 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000002:16020 2018-05-02 06:24:26,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:24:26,824 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:24:26,847 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:24:26,847 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:24:26,847 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:24:26,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:24:26,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:24:26,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:24:26,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:24:26,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:24:26,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:24:26,848 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:24:26,849 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:24:26,849 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:24:27,083 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:24:27,086 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:24:27,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:24:27,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:24:27,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:24:27,097 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:24:27,153 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:24:27,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:24:27,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:24:27,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:24:27,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:24:27,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:24:27,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:24:27,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:24:27,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:24:27,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:24:27,166 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:24:27,167 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:24:27,168 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:24:27,168 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:24:27,168 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:24:27,168 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:24:27,169 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:24:27,169 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:24:27,169 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:24:27,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:24:27,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:24:27,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:24:27,179 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:24:27,231 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:24:27,259 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:24:27,259 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:24:27,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:24:27,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:24:27,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:24:27,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:24:27,261 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:24:27,266 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:24:27,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:24:27,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:24:27,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:24:27,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:24:27,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:24:27,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:24:27,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:24:27,267 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:24:27,268 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:24:27,268 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:24:27,268 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:24:27,268 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:24:27,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:24:27,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:24:27,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:24:27,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:24:27,269 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:24:27,270 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:24:27,270 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:24:27,270 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:24:27,270 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:24:27,270 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:24:27,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:24:27,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:24:27,271 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:24:27,275 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:24:27,281 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:24:27,281 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:24:27,468 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:24:27,759 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:24:29,919 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:24:30,042 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:24:30,043 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:24:30,043 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:24:30,044 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:24:30,044 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:24:30,069 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000003.hwx.site,20000,1525241326264 with port=16020, startcode=1525242258983 2018-05-02 06:24:30,177 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:24:30,177 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:24:30,178 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:24:30,293 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:24:30,309 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:24:30,342 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:24:30,346 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:24:30,347 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:24:30,348 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:24:30,349 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:24:30,437 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:24:30,437 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:24:30,437 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:24:30,480 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:24:30,495 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:30,737 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:24:30,760 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:24:30,926 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:24:30,972 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:24:31,049 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:24:31,078 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:24:31,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:24:31,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:24:31,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:24:31,115 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:24:31,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:24:31,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:24:31,116 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:24:31,118 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:24:31,160 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 starting 2018-05-02 06:24:31,162 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:24:31,166 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:24:31,170 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:24:31,174 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:24:31,178 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:24:31,190 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525240839855] other RSs: [ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042] 2018-05-02 06:24:31,225 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, RpcServer on ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:16020, sessionid=0x3631f08b27900bb 2018-05-02 06:24:31,226 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:24:31,226 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:31,226 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983' 2018-05-02 06:24:31,226 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:24:31,227 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:24:31,228 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:24:31,228 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:24:31,228 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:31,228 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983' 2018-05-02 06:24:31,228 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:24:31,228 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:24:31,229 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:24:31,229 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:24:31,229 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:24:31,658 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:31,659 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:24:34,332 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525242258983, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:24:34,832 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Slow sync cost: 368 ms, current pipeline: [] 2018-05-02 06:24:34,832 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525242258983.1525242274333 2018-05-02 06:24:34,833 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK], DatanodeInfoWithStorage[172.27.61.83:1019,DS-376ef077-bfa4-4d85-90a0-6b3853a21bbd,DISK]] 2018-05-02 06:24:43,537 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:24:43,544 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:24:43,544 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:24:43,553 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 107 from saslServer. 2018-05-02 06:24:43,565 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:24:43,566 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:24:43,567 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:24:43,568 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:24:43,568 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:24:43,775 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:24:43,904 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:24:43,965 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 6e9424b67ac115dc3547de9b3eb4c5ef, NAME => 'test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef.', STARTKEY => '^P\xD7\x945\xE5\x0Dl', ENDKEY => 'e\x0DyC^P\xD7\x86'} 2018-05-02 06:24:43,965 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => a97e624ee736c77fbc6ccefb3abbac31, NAME => 'test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31.', STARTKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A', ENDKEY => '\x0DyC^P\xD7\x944'} 2018-05-02 06:24:44,176 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=AuthenticationService 2018-05-02 06:24:44,176 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=AuthenticationService 2018-05-02 06:24:44,181 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:44,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=SecureBulkLoadService 2018-05-02 06:24:44,186 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:44,186 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:44,186 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:44,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=AccessControlService 2018-05-02 06:24:44,187 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:44,187 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:44,189 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:44,189 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=SecureBulkLoadService 2018-05-02 06:24:44,190 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:44,190 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:44,190 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:44,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. service=AccessControlService 2018-05-02 06:24:44,190 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:44,190 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:44,230 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 6e9424b67ac115dc3547de9b3eb4c5ef 2018-05-02 06:24:44,230 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am a97e624ee736c77fbc6ccefb3abbac31 2018-05-02 06:24:44,230 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:24:44,230 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:24:44,263 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:44,265 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:44,376 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1 2018-05-02 06:24:44,376 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1 2018-05-02 06:24:44,376 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1 2018-05-02 06:24:44,377 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1 2018-05-02 06:24:44,425 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:44,426 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:44,448 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:44,448 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:44,717 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1/6cba47e832104f3da47cbb23a9bc05f2 2018-05-02 06:24:44,718 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1/586a58cac1d944569e94cf4983feab67 2018-05-02 06:24:44,801 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1/75a153d8f4a240b1ac387295522fdac6 2018-05-02 06:24:44,807 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:44,848 DEBUG [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/f1/8e427e1bd0004b8fa56fee85c7cc2ff5 2018-05-02 06:24:44,850 INFO [StoreOpener-a97e624ee736c77fbc6ccefb3abbac31-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:44,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31 2018-05-02 06:24:44,890 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef 2018-05-02 06:24:44,964 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:24:44,964 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:24:44,974 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened a97e624ee736c77fbc6ccefb3abbac31; next sequenceid=417 2018-05-02 06:24:44,978 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 6e9424b67ac115dc3547de9b3eb4c5ef; next sequenceid=414 2018-05-02 06:24:45,067 INFO [PostOpenDeployTasks:6e9424b67ac115dc3547de9b3eb4c5ef] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:24:45,067 INFO [PostOpenDeployTasks:a97e624ee736c77fbc6ccefb3abbac31] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:24:45,108 DEBUG [PostOpenDeployTasks:6e9424b67ac115dc3547de9b3eb4c5ef] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:24:45,110 DEBUG [PostOpenDeployTasks:a97e624ee736c77fbc6ccefb3abbac31] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:24:45,110 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:45,110 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:45,730 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:24:45,743 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => 2fd8c4d5abf9928da8e8c547a0ca223a, NAME => 'test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:24:45,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AuthenticationService 2018-05-02 06:24:45,744 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:45,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=SecureBulkLoadService 2018-05-02 06:24:45,744 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:45,744 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:45,744 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:45,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AccessControlService 2018-05-02 06:24:45,744 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:45,744 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:45,745 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 06:24:45,745 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:24:45,745 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:45,768 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 06:24:45,768 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 06:24:45,770 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:45,771 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:45,824 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf/99bf1b2ad42a4ca9af12e2d310e96ee0 2018-05-02 06:24:45,825 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:45,837 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 06:24:45,887 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12324.seqid, newMaxSeqId=12324, maxSeqId=12323 2018-05-02 06:24:45,894 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened 2fd8c4d5abf9928da8e8c547a0ca223a; next sequenceid=12324 2018-05-02 06:24:45,898 INFO [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:24:45,908 DEBUG [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:24:45,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:46,731 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:24:46,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => 0fc1f394ae11e950c87a982abf7c1035, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035.', STARTKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4', ENDKEY => '\xB5\xE5\x0DyC^P\xBE'} 2018-05-02 06:24:46,749 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=AuthenticationService 2018-05-02 06:24:46,749 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:46,749 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=SecureBulkLoadService 2018-05-02 06:24:46,749 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:46,750 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:46,750 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:46,750 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=AccessControlService 2018-05-02 06:24:46,750 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:46,750 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:46,751 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 0fc1f394ae11e950c87a982abf7c1035 2018-05-02 06:24:46,751 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:24:46,752 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:46,770 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1 2018-05-02 06:24:46,770 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1 2018-05-02 06:24:46,772 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:46,773 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:46,821 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1/bd1273938dfa4fcf838a564a80d2fa5b 2018-05-02 06:24:46,821 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:46,833 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035 2018-05-02 06:24:46,869 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:24:46,876 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened 0fc1f394ae11e950c87a982abf7c1035; next sequenceid=408 2018-05-02 06:24:46,881 INFO [PostOpenDeployTasks:0fc1f394ae11e950c87a982abf7c1035] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:24:46,885 DEBUG [PostOpenDeployTasks:0fc1f394ae11e950c87a982abf7c1035] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:24:46,885 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:47,562 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:24:47,581 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:24:47,581 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => 682775c01c8d957d744ae2b280c815cd, NAME => 'test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 06:24:47,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=AuthenticationService 2018-05-02 06:24:47,582 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:47,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=SecureBulkLoadService 2018-05-02 06:24:47,582 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:47,582 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:47,582 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:47,583 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. service=AccessControlService 2018-05-02 06:24:47,583 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:47,583 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:47,583 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 682775c01c8d957d744ae2b280c815cd 2018-05-02 06:24:47,583 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:24:47,584 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:47,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:24:47,642 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf 2018-05-02 06:24:47,642 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf 2018-05-02 06:24:47,644 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:47,645 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:47,650 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 06:24:47,650 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:47,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 06:24:47,651 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:47,651 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:47,651 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:47,651 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 06:24:47,651 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:47,651 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:47,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:24:47,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:24:47,652 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:47,670 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:24:47,670 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:24:47,675 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:47,677 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:47,692 DEBUG [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/test_cf/3dabedf14f6c4208ad17e7be0d53907d 2018-05-02 06:24:47,693 INFO [StoreOpener-682775c01c8d957d744ae2b280c815cd-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:47,706 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd 2018-05-02 06:24:47,732 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 06:24:47,733 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:47,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:24:47,752 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/recovered.edits/12505.seqid, newMaxSeqId=12505, maxSeqId=12504 2018-05-02 06:24:47,759 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened 682775c01c8d957d744ae2b280c815cd; next sequenceid=12505 2018-05-02 06:24:47,769 INFO [PostOpenDeployTasks:682775c01c8d957d744ae2b280c815cd] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:24:47,778 DEBUG [PostOpenDeployTasks:682775c01c8d957d744ae2b280c815cd] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:24:47,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:47,790 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11474.seqid, newMaxSeqId=11474, maxSeqId=11473 2018-05-02 06:24:47,796 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=11474 2018-05-02 06:24:47,800 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:24:47,803 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:24:47,804 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:48,321 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@7984376a 2018-05-02 06:24:48,323 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:24:48,324 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:24:48,325 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:24:48,329 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c0106, negotiated timeout = 10000 2018-05-02 06:24:48,376 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 06:24:48,384 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 06:24:48,607 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:24:48,622 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => f3db9f9879ed03f488dcb89bea834237, NAME => 'test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 06:24:48,622 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AuthenticationService 2018-05-02 06:24:48,623 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:48,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=SecureBulkLoadService 2018-05-02 06:24:48,623 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:48,623 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:48,623 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:48,623 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. service=AccessControlService 2018-05-02 06:24:48,623 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:48,624 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:48,624 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3db9f9879ed03f488dcb89bea834237 2018-05-02 06:24:48,624 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:24:48,624 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:48,639 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 06:24:48,639 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf 2018-05-02 06:24:48,640 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:48,641 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:48,672 DEBUG [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/test_cf/aaada1ce8b1645138ee709ff8cb7aa8f 2018-05-02 06:24:48,672 INFO [StoreOpener-f3db9f9879ed03f488dcb89bea834237-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:48,680 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237 2018-05-02 06:24:48,733 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12081.seqid, newMaxSeqId=12081, maxSeqId=12080 2018-05-02 06:24:48,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened f3db9f9879ed03f488dcb89bea834237; next sequenceid=12081 2018-05-02 06:24:48,746 INFO [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:24:48,750 DEBUG [PostOpenDeployTasks:f3db9f9879ed03f488dcb89bea834237] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:24:48,753 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:48,813 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:24:48,813 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:24:48,813 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:24:48,813 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:24:49,037 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:24:49,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => 83a4166017315b69b94bd868d994447b, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b.', STARTKEY => '\x8DyC^P\xD7\x94"', ENDKEY => '\x945\xE5\x0DyC^<'} 2018-05-02 06:24:49,062 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. service=AuthenticationService 2018-05-02 06:24:49,062 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:49,062 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. service=SecureBulkLoadService 2018-05-02 06:24:49,062 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:49,062 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:49,062 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:49,062 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. service=AccessControlService 2018-05-02 06:24:49,063 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:49,063 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:49,063 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 83a4166017315b69b94bd868d994447b 2018-05-02 06:24:49,063 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:24:49,063 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:49,078 DEBUG [StoreOpener-83a4166017315b69b94bd868d994447b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/f1 2018-05-02 06:24:49,078 DEBUG [StoreOpener-83a4166017315b69b94bd868d994447b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/f1 2018-05-02 06:24:49,080 INFO [StoreOpener-83a4166017315b69b94bd868d994447b-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:49,081 INFO [StoreOpener-83a4166017315b69b94bd868d994447b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:49,115 DEBUG [StoreOpener-83a4166017315b69b94bd868d994447b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/f1/feeed6316aa4472a883749a8aeb53dd3 2018-05-02 06:24:49,115 INFO [StoreOpener-83a4166017315b69b94bd868d994447b-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:49,124 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b 2018-05-02 06:24:49,151 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:24:49,155 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened 83a4166017315b69b94bd868d994447b; next sequenceid=408 2018-05-02 06:24:49,159 INFO [PostOpenDeployTasks:83a4166017315b69b94bd868d994447b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:24:49,163 DEBUG [PostOpenDeployTasks:83a4166017315b69b94bd868d994447b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:24:49,163 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:49,230 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:24:49,232 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:24:49,238 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:24:49,702 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:24:49,714 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:24:49,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => b8144dc37f351e256653e1454207538f, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f.', STARTKEY => '\xE5\x0DyC^P\xD7t', ENDKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E'} 2018-05-02 06:24:49,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=AuthenticationService 2018-05-02 06:24:49,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:49,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=SecureBulkLoadService 2018-05-02 06:24:49,715 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:49,715 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:49,715 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:49,716 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=AccessControlService 2018-05-02 06:24:49,717 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:49,717 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:49,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b8144dc37f351e256653e1454207538f 2018-05-02 06:24:49,717 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:24:49,717 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:49,725 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => ce3059196e012fe2ffadcb5d2b348ce3, NAME => 'test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 06:24:49,725 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AuthenticationService 2018-05-02 06:24:49,725 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:49,725 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=SecureBulkLoadService 2018-05-02 06:24:49,725 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:49,726 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:49,726 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:49,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AccessControlService 2018-05-02 06:24:49,726 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:49,726 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:49,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 06:24:49,726 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:24:49,727 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:49,734 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1 2018-05-02 06:24:49,734 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1 2018-05-02 06:24:49,736 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:49,736 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:49,749 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 06:24:49,749 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 06:24:49,750 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:49,751 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:49,756 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:24:49,785 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1/2634850b34ea44e88f4b0d654c593d82 2018-05-02 06:24:49,830 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1/b9fd06c3a1d143b3955e7818940543a8 2018-05-02 06:24:49,830 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:49,831 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf 2018-05-02 06:24:49,832 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:49,845 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 06:24:49,846 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f 2018-05-02 06:24:49,956 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12810.seqid, newMaxSeqId=12810, maxSeqId=12809 2018-05-02 06:24:49,962 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened ce3059196e012fe2ffadcb5d2b348ce3; next sequenceid=12810 2018-05-02 06:24:49,966 INFO [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:24:49,968 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:24:49,969 DEBUG [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:24:49,969 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:49,973 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened b8144dc37f351e256653e1454207538f; next sequenceid=411 2018-05-02 06:24:49,979 INFO [PostOpenDeployTasks:b8144dc37f351e256653e1454207538f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:24:49,982 DEBUG [PostOpenDeployTasks:b8144dc37f351e256653e1454207538f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:24:49,982 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:50,164 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:24:50,165 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:24:50,245 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:24:50,245 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:24:50,245 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:24:50,252 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:24:50,255 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:24:50,255 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:24:50,720 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:24:50,731 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:24:50,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => b52f5cecdefd18652f3e796b8dada29f, NAME => 'test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f.', STARTKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E', ENDKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8'} 2018-05-02 06:24:50,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=AuthenticationService 2018-05-02 06:24:50,732 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:50,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=SecureBulkLoadService 2018-05-02 06:24:50,732 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:50,732 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:50,732 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:50,732 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. service=AccessControlService 2018-05-02 06:24:50,733 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:50,733 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:50,733 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b52f5cecdefd18652f3e796b8dada29f 2018-05-02 06:24:50,733 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:24:50,733 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:50,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => 022c10bc256d7e8dc5d475d7ff8545ea, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:24:50,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AuthenticationService 2018-05-02 06:24:50,740 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:50,740 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=SecureBulkLoadService 2018-05-02 06:24:50,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:50,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:50,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:50,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AccessControlService 2018-05-02 06:24:50,741 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:50,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:50,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:24:50,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:24:50,743 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:50,746 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1 2018-05-02 06:24:50,746 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1 2018-05-02 06:24:50,747 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:50,748 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:50,757 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:24:50,757 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:24:50,759 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:50,760 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:50,775 DEBUG [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/f1/c0a6bd8873ac486db9e40f6c058b5bcd 2018-05-02 06:24:50,775 INFO [StoreOpener-b52f5cecdefd18652f3e796b8dada29f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:50,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f 2018-05-02 06:24:50,803 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/58da7717f6144f42a435d0770d1a1079 2018-05-02 06:24:50,821 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:24:50,826 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened b52f5cecdefd18652f3e796b8dada29f; next sequenceid=414 2018-05-02 06:24:50,826 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/845389644a5e479097fbc8df18727132 2018-05-02 06:24:50,826 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:50,829 INFO [PostOpenDeployTasks:b52f5cecdefd18652f3e796b8dada29f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:24:50,833 DEBUG [PostOpenDeployTasks:b52f5cecdefd18652f3e796b8dada29f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:24:50,833 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:50,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:24:50,861 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:24:50,865 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened 022c10bc256d7e8dc5d475d7ff8545ea; next sequenceid=414 2018-05-02 06:24:50,868 INFO [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:24:50,872 DEBUG [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:24:50,872 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:50,927 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:24:50,943 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opening region: {ENCODED => 084aa7d8a3bd4d7483494d5a2c39d5df, NAME => 'test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 06:24:50,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AuthenticationService 2018-05-02 06:24:50,944 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:50,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=SecureBulkLoadService 2018-05-02 06:24:50,944 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:50,944 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:50,944 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:50,945 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AccessControlService 2018-05-02 06:24:50,945 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:50,945 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:50,946 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 06:24:50,946 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:24:50,946 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:50,961 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 06:24:50,961 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 06:24:50,962 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:50,963 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:51,001 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf/9f7cb69b6abe4f57bb56248fe3e04156 2018-05-02 06:24:51,001 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:51,017 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 06:24:51,047 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12602.seqid, newMaxSeqId=12602, maxSeqId=12601 2018-05-02 06:24:51,053 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opened 084aa7d8a3bd4d7483494d5a2c39d5df; next sequenceid=12602 2018-05-02 06:24:51,057 INFO [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:24:51,061 DEBUG [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:24:51,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:51,651 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:24:51,651 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 06:24:51,652 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:24:51,652 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 06:24:51,653 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:24:51,653 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 06:24:51,746 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:24:51,757 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:24:51,757 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => 3bbeffd33dfc99ea8862c8eae819df62, NAME => 'test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 06:24:51,758 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AuthenticationService 2018-05-02 06:24:51,758 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:51,758 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=SecureBulkLoadService 2018-05-02 06:24:51,758 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:51,758 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:51,758 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:51,758 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AccessControlService 2018-05-02 06:24:51,759 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:51,759 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:51,759 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 06:24:51,759 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:24:51,759 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:51,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:24:51,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 06:24:51,773 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:51,773 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 06:24:51,773 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:51,773 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:51,773 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:51,775 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 06:24:51,775 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:51,775 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:51,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:24:51,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:24:51,776 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 06:24:51,776 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 06:24:51,782 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:51,783 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:51,797 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:24:51,797 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:24:51,798 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:51,799 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:51,831 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf/081e4f87bb6141d5bac9d82300027aa3 2018-05-02 06:24:51,832 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:51,837 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 06:24:51,838 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:51,860 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 06:24:51,861 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:24:51,893 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/37.seqid, newMaxSeqId=37, maxSeqId=36 2018-05-02 06:24:51,897 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12468.seqid, newMaxSeqId=12468, maxSeqId=12467 2018-05-02 06:24:51,898 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=37 2018-05-02 06:24:51,902 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:24:51,903 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened 3bbeffd33dfc99ea8862c8eae819df62; next sequenceid=12468 2018-05-02 06:24:51,905 INFO [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:24:51,906 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:24:51,906 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:51,908 DEBUG [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:24:51,909 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:52,577 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:24:52,587 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opening region: {ENCODED => 3b0ff50ae790418c1d7b36d704a3c7a8, NAME => 'test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8.', STARTKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8', ENDKEY => '\xC3^P\xD7\x945\xE4\xF2'} 2018-05-02 06:24:52,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=AuthenticationService 2018-05-02 06:24:52,589 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:52,589 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=SecureBulkLoadService 2018-05-02 06:24:52,589 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:52,589 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:52,589 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:52,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. service=AccessControlService 2018-05-02 06:24:52,590 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:52,590 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:52,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 06:24:52,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:24:52,591 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:52,605 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1 2018-05-02 06:24:52,605 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1 2018-05-02 06:24:52,607 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:52,608 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:52,641 DEBUG [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/f1/f9a518867ce041a0b9932823647fbc93 2018-05-02 06:24:52,641 INFO [StoreOpener-3b0ff50ae790418c1d7b36d704a3c7a8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:52,657 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8 2018-05-02 06:24:52,681 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:24:52,688 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opened 3b0ff50ae790418c1d7b36d704a3c7a8; next sequenceid=414 2018-05-02 06:24:52,695 INFO [PostOpenDeployTasks:3b0ff50ae790418c1d7b36d704a3c7a8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:24:52,699 DEBUG [PostOpenDeployTasks:3b0ff50ae790418c1d7b36d704a3c7a8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:24:52,700 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:53,065 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:24:53,075 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opening region: {ENCODED => fa24e8d8fdd999d38faae5dbf847c334, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334.', STARTKEY => '\x145\xE5\x0DyC^N', ENDKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h'} 2018-05-02 06:24:53,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AuthenticationService 2018-05-02 06:24:53,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:53,078 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=SecureBulkLoadService 2018-05-02 06:24:53,078 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:53,078 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:53,078 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:53,078 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AccessControlService 2018-05-02 06:24:53,078 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:53,078 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:53,078 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:24:53,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:24:53,079 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:53,099 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:24:53,099 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:24:53,101 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:53,103 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:53,128 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1/f817097956b04d90a34738b22c734e7a 2018-05-02 06:24:53,129 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:53,141 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:24:53,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:24:53,195 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opened fa24e8d8fdd999d38faae5dbf847c334; next sequenceid=408 2018-05-02 06:24:53,199 INFO [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:24:53,203 DEBUG [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:24:53,203 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:53,781 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:24:53,792 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:24:53,792 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opening region: {ENCODED => a6e0d7561c4f19e78f94d37462588281, NAME => 'test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:24:53,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AuthenticationService 2018-05-02 06:24:53,793 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:53,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=SecureBulkLoadService 2018-05-02 06:24:53,793 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:53,793 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:53,793 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:53,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. service=AccessControlService 2018-05-02 06:24:53,794 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:53,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:53,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode a6e0d7561c4f19e78f94d37462588281 2018-05-02 06:24:53,794 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:24:53,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:53,802 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opening region: {ENCODED => a58d4c86d2df306cc460a231fd5a1ac1, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 06:24:53,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=AuthenticationService 2018-05-02 06:24:53,803 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:53,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=SecureBulkLoadService 2018-05-02 06:24:53,803 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:53,803 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:53,803 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:53,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=AccessControlService 2018-05-02 06:24:53,803 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:53,803 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:53,804 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:24:53,804 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:24:53,804 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:53,807 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 06:24:53,807 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf 2018-05-02 06:24:53,808 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:53,809 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:53,817 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1 2018-05-02 06:24:53,817 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1 2018-05-02 06:24:53,818 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:53,819 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:53,865 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1/01f9f6a5501f41208ca4e0b19e9e7c04 2018-05-02 06:24:53,865 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:53,869 DEBUG [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/test_cf/456e1d1536eb4c76a936bf52d24b8c27 2018-05-02 06:24:53,869 INFO [StoreOpener-a6e0d7561c4f19e78f94d37462588281-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:53,874 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:24:53,876 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281 2018-05-02 06:24:53,902 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:24:53,906 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13476.seqid, newMaxSeqId=13476, maxSeqId=13475 2018-05-02 06:24:53,915 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opened a6e0d7561c4f19e78f94d37462588281; next sequenceid=13476 2018-05-02 06:24:53,917 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opened a58d4c86d2df306cc460a231fd5a1ac1; next sequenceid=411 2018-05-02 06:24:53,922 INFO [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:24:53,927 DEBUG [PostOpenDeployTasks:a6e0d7561c4f19e78f94d37462588281] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:24:53,927 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:53,938 INFO [PostOpenDeployTasks:a58d4c86d2df306cc460a231fd5a1ac1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:24:53,942 DEBUG [PostOpenDeployTasks:a58d4c86d2df306cc460a231fd5a1ac1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:24:53,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:54,614 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:24:54,624 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:24:54,625 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opening region: {ENCODED => 25414d6e395eadb383c40973693beb12, NAME => 'test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:24:54,625 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=AuthenticationService 2018-05-02 06:24:54,625 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:54,625 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=SecureBulkLoadService 2018-05-02 06:24:54,625 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:54,626 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:54,626 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:54,626 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=AccessControlService 2018-05-02 06:24:54,626 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:54,626 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:54,626 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 25414d6e395eadb383c40973693beb12 2018-05-02 06:24:54,626 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:24:54,627 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:54,638 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opening region: {ENCODED => 84c55bda386b9aa62a8b4df75ca9b38c, NAME => 'test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 06:24:54,638 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AuthenticationService 2018-05-02 06:24:54,639 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:54,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=SecureBulkLoadService 2018-05-02 06:24:54,639 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:54,639 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:54,639 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:54,639 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. service=AccessControlService 2018-05-02 06:24:54,639 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:54,639 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:54,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 06:24:54,640 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1 2018-05-02 06:24:54,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:24:54,640 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1 2018-05-02 06:24:54,640 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:54,641 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:54,642 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:54,655 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 06:24:54,655 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf 2018-05-02 06:24:54,656 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:54,657 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:54,668 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1/bc3bcfcc061c4f8983a05c3b21b4aba4 2018-05-02 06:24:54,699 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1/d841feb0096c401b9a78e0050ee83d68 2018-05-02 06:24:54,699 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:54,702 DEBUG [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/test_cf/e85dca4d9952403a8e861bb27c95db92 2018-05-02 06:24:54,702 INFO [StoreOpener-84c55bda386b9aa62a8b4df75ca9b38c-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:54,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12 2018-05-02 06:24:54,708 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c 2018-05-02 06:24:54,718 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:24:54,721 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:24:54,724 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:24:54,731 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11887.seqid, newMaxSeqId=11887, maxSeqId=11886 2018-05-02 06:24:54,734 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:24:54,736 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opened 84c55bda386b9aa62a8b4df75ca9b38c; next sequenceid=11887 2018-05-02 06:24:54,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opened 25414d6e395eadb383c40973693beb12; next sequenceid=417 2018-05-02 06:24:54,743 INFO [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:24:54,746 DEBUG [PostOpenDeployTasks:84c55bda386b9aa62a8b4df75ca9b38c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:24:54,746 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:54,751 INFO [PostOpenDeployTasks:25414d6e395eadb383c40973693beb12] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:24:54,754 DEBUG [PostOpenDeployTasks:25414d6e395eadb383c40973693beb12] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:24:54,755 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:55,233 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:24:55,336 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:24:55,345 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:24:55,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 7d91c8087e31e21951799651a5262353, NAME => 'test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x00\x00\x00\x00\x00'} 2018-05-02 06:24:55,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AuthenticationService 2018-05-02 06:24:55,347 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:55,347 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=SecureBulkLoadService 2018-05-02 06:24:55,347 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:55,347 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:55,347 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:55,347 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AccessControlService 2018-05-02 06:24:55,348 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:55,348 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:55,348 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7d91c8087e31e21951799651a5262353 2018-05-02 06:24:55,348 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:24:55,349 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:55,359 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => 1fa0746104343e63d4a6c982f8a3bf32, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32.', STARTKEY => '!\xAF(k\xCA\x1A\xF2\x82', ENDKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C'} 2018-05-02 06:24:55,359 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=AuthenticationService 2018-05-02 06:24:55,359 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:55,360 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=SecureBulkLoadService 2018-05-02 06:24:55,360 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:55,360 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:55,360 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:55,360 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=AccessControlService 2018-05-02 06:24:55,360 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:55,360 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:55,361 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 1fa0746104343e63d4a6c982f8a3bf32 2018-05-02 06:24:55,361 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:24:55,361 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:55,364 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 06:24:55,364 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 06:24:55,366 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:55,366 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:55,371 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:55,390 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1 2018-05-02 06:24:55,391 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1 2018-05-02 06:24:55,392 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:55,395 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:55,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353 2018-05-02 06:24:55,455 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1/d53deff6e1564e7f9a4b4dcf2158aa82 2018-05-02 06:24:55,455 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:55,464 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32 2018-05-02 06:24:55,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=7 2018-05-02 06:24:55,484 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 7d91c8087e31e21951799651a5262353; next sequenceid=8 2018-05-02 06:24:55,489 INFO [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:24:55,495 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:24:55,496 DEBUG [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:24:55,496 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:55,501 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 1fa0746104343e63d4a6c982f8a3bf32; next sequenceid=411 2018-05-02 06:24:55,505 INFO [PostOpenDeployTasks:1fa0746104343e63d4a6c982f8a3bf32] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:24:55,510 DEBUG [PostOpenDeployTasks:1fa0746104343e63d4a6c982f8a3bf32] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:24:55,510 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:55,685 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:24:55,686 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:24:55,971 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:24:55,971 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:24:55,972 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:24:55,981 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:24:55,985 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:24:55,985 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:24:56,039 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:24:56,247 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:24:56,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => 2e8da78a5421f95de8c75e0053e1d4a0, NAME => 'test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0.', STARTKEY => '\x945\xE5\x0DyC^<', ENDKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V'} 2018-05-02 06:24:56,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AuthenticationService 2018-05-02 06:24:56,257 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:56,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=SecureBulkLoadService 2018-05-02 06:24:56,258 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:56,258 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:56,258 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:56,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. service=AccessControlService 2018-05-02 06:24:56,258 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:56,258 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:56,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:24:56,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:24:56,259 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:56,270 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:24:56,270 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1 2018-05-02 06:24:56,271 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:56,272 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:56,308 DEBUG [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/f1/4a57c45b7e83443f9ac51c1f0ee9e848 2018-05-02 06:24:56,309 INFO [StoreOpener-2e8da78a5421f95de8c75e0053e1d4a0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:56,316 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0 2018-05-02 06:24:56,340 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:24:56,346 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened 2e8da78a5421f95de8c75e0053e1d4a0; next sequenceid=417 2018-05-02 06:24:56,350 INFO [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:24:56,353 DEBUG [PostOpenDeployTasks:2e8da78a5421f95de8c75e0053e1d4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:24:56,354 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:57,056 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:24:57,066 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:24:57,066 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => f3ccd3e0671152671071dbba3e2cb560, NAME => 'test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 06:24:57,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AuthenticationService 2018-05-02 06:24:57,067 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:57,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=SecureBulkLoadService 2018-05-02 06:24:57,067 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:57,067 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:57,067 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:57,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. service=AccessControlService 2018-05-02 06:24:57,068 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:57,068 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:57,068 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode f3ccd3e0671152671071dbba3e2cb560 2018-05-02 06:24:57,068 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:24:57,069 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:57,075 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => 843b3b66a19c1c2d494720e99edc9c52, NAME => 'test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52.', STARTKEY => '/(k\xCA\x1A\xF2\x86\xB6', ENDKEY => '5\xE5\x0DyC^P\xD0'} 2018-05-02 06:24:57,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=AuthenticationService 2018-05-02 06:24:57,076 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:57,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=SecureBulkLoadService 2018-05-02 06:24:57,076 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:57,076 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:57,076 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:57,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=AccessControlService 2018-05-02 06:24:57,077 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:57,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:57,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 843b3b66a19c1c2d494720e99edc9c52 2018-05-02 06:24:57,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:24:57,078 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:57,081 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 06:24:57,081 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf 2018-05-02 06:24:57,083 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:57,083 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:57,090 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1 2018-05-02 06:24:57,090 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1 2018-05-02 06:24:57,091 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:57,091 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:57,108 DEBUG [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/test_cf/0a4f5f73439447d58ac2371e0ea69f1f 2018-05-02 06:24:57,108 INFO [StoreOpener-f3ccd3e0671152671071dbba3e2cb560-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:57,114 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560 2018-05-02 06:24:57,132 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1/21db71a596184e8987d3b0a857d2a3d8 2018-05-02 06:24:57,132 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:57,144 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52 2018-05-02 06:24:57,149 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12800.seqid, newMaxSeqId=12800, maxSeqId=12799 2018-05-02 06:24:57,157 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened f3ccd3e0671152671071dbba3e2cb560; next sequenceid=12800 2018-05-02 06:24:57,161 INFO [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:24:57,166 DEBUG [PostOpenDeployTasks:f3ccd3e0671152671071dbba3e2cb560] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:24:57,166 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:57,174 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:24:57,179 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened 843b3b66a19c1c2d494720e99edc9c52; next sequenceid=414 2018-05-02 06:24:57,182 INFO [PostOpenDeployTasks:843b3b66a19c1c2d494720e99edc9c52] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:24:57,186 DEBUG [PostOpenDeployTasks:843b3b66a19c1c2d494720e99edc9c52] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:24:57,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:58,344 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:24:58,360 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => e56a9c7383092895c06ee33b9b84d892, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892.', STARTKEY => '\xA1\xAF(k\xCA\x1A\xF2p', ENDKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A'} 2018-05-02 06:24:58,360 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. service=AuthenticationService 2018-05-02 06:24:58,363 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:24:58,363 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. service=SecureBulkLoadService 2018-05-02 06:24:58,363 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:24:58,363 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:24:58,363 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:24:58,363 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. service=AccessControlService 2018-05-02 06:24:58,363 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:24:58,364 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:24:58,364 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e56a9c7383092895c06ee33b9b84d892 2018-05-02 06:24:58,364 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:24:58,364 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:24:58,401 DEBUG [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/f1 2018-05-02 06:24:58,401 DEBUG [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/f1 2018-05-02 06:24:58,402 INFO [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:24:58,403 INFO [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:24:58,444 DEBUG [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/f1/cb0610e65b5444349a49772cf9289fa4 2018-05-02 06:24:58,444 INFO [StoreOpener-e56a9c7383092895c06ee33b9b84d892-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:24:58,456 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892 2018-05-02 06:24:58,486 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:24:58,491 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened e56a9c7383092895c06ee33b9b84d892; next sequenceid=408 2018-05-02 06:24:58,495 INFO [PostOpenDeployTasks:e56a9c7383092895c06ee33b9b84d892] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:24:58,499 DEBUG [PostOpenDeployTasks:e56a9c7383092895c06ee33b9b84d892] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:24:58,499 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:24:59,627 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:24:59,629 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:24:59,632 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:25:00,137 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:25:00,439 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:25:00,439 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:25:00,650 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:25:00,650 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:25:00,650 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:25:00,658 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:25:00,661 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:25:00,661 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:25:26,868 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x557c7f56] zookeeper.ZooKeeper: Session: 0x2631f08d93900c0 closed 2018-05-02 06:25:26,868 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x557c7f56-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:25:27,281 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.020 minutes, events=24, succcessCount=12, totalEvents=24, totalSuccessCount=12 2018-05-02 06:25:29,441 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:25:29,442 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:25:29,445 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:25:29,452 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:25:29,452 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/9 2018-05-02 06:25:29,454 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:25:29,458 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 2018-05-02 06:25:29,461 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525240933892 znode expired, triggering replicatorRemoved event 2018-05-02 06:25:29,462 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:25:29,964 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:25:30,004 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => 530aabaf92e988eadd5338ed38b9be0c, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c.', STARTKEY => '\x00\x00\x00\x00\x00\x00\x00\x00', ENDKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A'} 2018-05-02 06:25:30,007 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=AuthenticationService 2018-05-02 06:25:30,007 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,008 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=SecureBulkLoadService 2018-05-02 06:25:30,008 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,008 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,008 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,008 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=AccessControlService 2018-05-02 06:25:30,008 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,008 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,009 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 530aabaf92e988eadd5338ed38b9be0c 2018-05-02 06:25:30,009 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:25:30,009 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,014 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:25:30,062 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1 2018-05-02 06:25:30,062 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1 2018-05-02 06:25:30,064 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,064 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,074 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => 45aba4505046246827a28b03d1c2611e, NAME => 'test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e.', STARTKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4', ENDKEY => '\xB5\xE5\x0DyC^P\xBE'} 2018-05-02 06:25:30,074 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=AuthenticationService 2018-05-02 06:25:30,074 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:25:30,075 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=SecureBulkLoadService 2018-05-02 06:25:30,075 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:25:30,075 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:25:30,075 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:25:30,075 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=AccessControlService 2018-05-02 06:25:30,075 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:25:30,075 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:25:30,075 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 45aba4505046246827a28b03d1c2611e 2018-05-02 06:25:30,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:25:30,076 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:25:30,129 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1 2018-05-02 06:25:30,129 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1 2018-05-02 06:25:30,130 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:25:30,130 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:25:30,184 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1/2c6b0a92ce6e4b29b4f5e46b400fa68f 2018-05-02 06:25:30,238 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1/9183f33444af4ba4b0488cd21989a0e1 2018-05-02 06:25:30,252 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1/649450abe53e433192b35544d0e0ab96 2018-05-02 06:25:30,253 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c 2018-05-02 06:25:30,290 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1/9ca70b0c41a14a7db0a7b4b70bd83580 2018-05-02 06:25:30,291 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:25:30,301 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e 2018-05-02 06:25:30,305 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:25:30,311 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened 530aabaf92e988eadd5338ed38b9be0c; next sequenceid=411 2018-05-02 06:25:30,332 INFO [PostOpenDeployTasks:530aabaf92e988eadd5338ed38b9be0c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:25:30,336 DEBUG [PostOpenDeployTasks:530aabaf92e988eadd5338ed38b9be0c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:25:30,337 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:25:30,343 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:25:30,353 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened 45aba4505046246827a28b03d1c2611e; next sequenceid=420 2018-05-02 06:25:30,365 INFO [PostOpenDeployTasks:45aba4505046246827a28b03d1c2611e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:25:30,369 DEBUG [PostOpenDeployTasks:45aba4505046246827a28b03d1c2611e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:25:30,372 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:25:33,282 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:06.115 minutes, events=12, succcessCount=12, totalEvents=12, totalSuccessCount=12 2018-05-02 06:25:35,009 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:25:35,011 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:25:35,013 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:25:35,517 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:25:35,886 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:25:35,887 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:25:35,958 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:25:35,958 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:25:35,958 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:25:35,963 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:25:35,967 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:25:35,967 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:26:00,803 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:26:27,288 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.007 minutes, events=4, succcessCount=2, totalEvents=28, totalSuccessCount=14 2018-05-02 06:26:56,689 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 2018-05-02 06:26:56,693 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525241028042 znode expired, triggering replicatorRemoved event 2018-05-02 06:26:56,694 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:26:57,049 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:26:57,073 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:26:57,074 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => dc953453430fbf031584084fad7c31bd, NAME => 'test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 06:26:57,075 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=AuthenticationService 2018-05-02 06:26:57,075 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,075 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=SecureBulkLoadService 2018-05-02 06:26:57,075 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,075 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,075 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=AccessControlService 2018-05-02 06:26:57,077 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase dc953453430fbf031584084fad7c31bd 2018-05-02 06:26:57,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:26:57,078 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,083 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => 3f499471b0415a38ad5efe046913cba2, NAME => 'test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2.', STARTKEY => '\xDEP\xD7\x945\xE5\x0DZ', ENDKEY => '\xE5\x0DyC^P\xD7t'} 2018-05-02 06:26:57,084 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AuthenticationService 2018-05-02 06:26:57,084 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,084 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=SecureBulkLoadService 2018-05-02 06:26:57,084 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,084 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,084 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,085 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AccessControlService 2018-05-02 06:26:57,085 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,085 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,085 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3f499471b0415a38ad5efe046913cba2 2018-05-02 06:26:57,085 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:26:57,086 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,096 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf 2018-05-02 06:26:57,096 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf 2018-05-02 06:26:57,097 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,098 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,120 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:26:57,120 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:26:57,121 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,123 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,145 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf/d830ee103d2b41e0ad35903c835935d7 2018-05-02 06:26:57,145 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,146 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1/abc0da0f84f64790a2c93880ca66ac5e 2018-05-02 06:26:57,146 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,155 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2 2018-05-02 06:26:57,155 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd 2018-05-02 06:26:57,180 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/recovered.edits/12690.seqid, newMaxSeqId=12690, maxSeqId=12689 2018-05-02 06:26:57,185 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:26:57,185 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened dc953453430fbf031584084fad7c31bd; next sequenceid=12690 2018-05-02 06:26:57,191 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened 3f499471b0415a38ad5efe046913cba2; next sequenceid=417 2018-05-02 06:26:57,193 INFO [PostOpenDeployTasks:dc953453430fbf031584084fad7c31bd] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:26:57,194 INFO [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:26:57,197 DEBUG [PostOpenDeployTasks:dc953453430fbf031584084fad7c31bd] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:26:57,197 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:26:57,198 DEBUG [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:26:57,198 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:26:57,242 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:26:57,269 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:26:57,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => 47377dfacc235cc247254a0eb8fe4f44, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44.', STARTKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0', ENDKEY => 'r\x86\xBC\xA1\xAF(k\xBA'} 2018-05-02 06:26:57,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. service=AuthenticationService 2018-05-02 06:26:57,270 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. service=SecureBulkLoadService 2018-05-02 06:26:57,271 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,271 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,271 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. service=AccessControlService 2018-05-02 06:26:57,271 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,271 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 47377dfacc235cc247254a0eb8fe4f44 2018-05-02 06:26:57,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:26:57,272 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,277 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:26:57,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => 51969dda9dfa8895c283f334f944e248, NAME => 'test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248.', STARTKEY => '\xD0\xD7\x945\xE5\x0Dy&', ENDKEY => '\xD7\x945\xE5\x0DyC@'} 2018-05-02 06:26:57,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opening region: {ENCODED => 7524beb6ac348dac037dbf298ba07495, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495.', STARTKEY => '5\xE5\x0DyC^P\xD0', ENDKEY => '<\xA1\xAF(k\xCA\x1A\xEA'} 2018-05-02 06:26:57,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AuthenticationService 2018-05-02 06:26:57,277 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=AuthenticationService 2018-05-02 06:26:57,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=SecureBulkLoadService 2018-05-02 06:26:57,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. service=AccessControlService 2018-05-02 06:26:57,278 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 7524beb6ac348dac037dbf298ba07495 2018-05-02 06:26:57,279 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:26:57,279 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,278 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=SecureBulkLoadService 2018-05-02 06:26:57,280 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,280 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,280 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AccessControlService 2018-05-02 06:26:57,281 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,281 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51969dda9dfa8895c283f334f944e248 2018-05-02 06:26:57,281 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:26:57,282 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,283 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:26:57,284 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:26:57,284 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => 19c6e3a27177cc57e6cf72ac907048ed, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed.', STARTKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V', ENDKEY => '\xA1\xAF(k\xCA\x1A\xF2p'} 2018-05-02 06:26:57,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=AuthenticationService 2018-05-02 06:26:57,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,285 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=SecureBulkLoadService 2018-05-02 06:26:57,285 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,285 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,285 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=AccessControlService 2018-05-02 06:26:57,286 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,286 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 19c6e3a27177cc57e6cf72ac907048ed 2018-05-02 06:26:57,286 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:26:57,287 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,287 DEBUG [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/f1 2018-05-02 06:26:57,287 DEBUG [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/f1 2018-05-02 06:26:57,288 INFO [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,289 INFO [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,289 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opening region: {ENCODED => 299c3061e2a10cee5be3bff86a2ec41a, NAME => 'test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a.', STARTKEY => '\xB5\xE5\x0DyC^P\xBE', ENDKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8'} 2018-05-02 06:26:57,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=AuthenticationService 2018-05-02 06:26:57,290 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:26:57,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=SecureBulkLoadService 2018-05-02 06:26:57,290 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:26:57,290 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:26:57,290 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:26:57,290 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=AccessControlService 2018-05-02 06:26:57,291 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:26:57,291 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:26:57,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 299c3061e2a10cee5be3bff86a2ec41a 2018-05-02 06:26:57,291 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:26:57,291 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:26:57,294 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:24.012 minutes, events=2, succcessCount=2, totalEvents=14, totalSuccessCount=14 2018-05-02 06:26:57,300 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1 2018-05-02 06:26:57,300 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1 2018-05-02 06:26:57,301 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,302 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,306 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:26:57,306 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:26:57,307 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,308 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,311 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1 2018-05-02 06:26:57,311 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1 2018-05-02 06:26:57,312 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,313 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,313 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1 2018-05-02 06:26:57,313 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1 2018-05-02 06:26:57,314 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:26:57,315 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:26:57,357 DEBUG [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/f1/abb993ca728f419faab17bf60d381de0 2018-05-02 06:26:57,357 DEBUG [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/f1/1d1b806509a34e0c9777f7096fbc3f1c 2018-05-02 06:26:57,357 INFO [StoreOpener-47377dfacc235cc247254a0eb8fe4f44-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,357 INFO [StoreOpener-7524beb6ac348dac037dbf298ba07495-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,365 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495 2018-05-02 06:26:57,366 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44 2018-05-02 06:26:57,372 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1/1ea04ea101ef4b97b972fcf1e2c389dc 2018-05-02 06:26:57,373 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/62e84ec5a089460ba8f74c367544ffaa 2018-05-02 06:26:57,387 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1/4f8205bfef3349d1b86f968ec0fb4484 2018-05-02 06:26:57,391 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1/c2e9664311c1425886ec633633fdcd6b 2018-05-02 06:26:57,391 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,392 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:26:57,393 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/7710e9b7b85f4d579e501a6dce5fd537 2018-05-02 06:26:57,393 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,399 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:26:57,402 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opened 7524beb6ac348dac037dbf298ba07495; next sequenceid=408 2018-05-02 06:26:57,403 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a 2018-05-02 06:26:57,404 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened 47377dfacc235cc247254a0eb8fe4f44; next sequenceid=411 2018-05-02 06:26:57,405 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248 2018-05-02 06:26:57,412 INFO [PostOpenDeployTasks:7524beb6ac348dac037dbf298ba07495] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:26:57,415 DEBUG [PostOpenDeployTasks:7524beb6ac348dac037dbf298ba07495] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:26:57,415 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:26:57,418 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1/ac824897155b4c70ba4abc8ffd2779e9 2018-05-02 06:26:57,418 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:26:57,418 INFO [PostOpenDeployTasks:47377dfacc235cc247254a0eb8fe4f44] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:26:57,424 DEBUG [PostOpenDeployTasks:47377dfacc235cc247254a0eb8fe4f44] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:26:57,424 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:26:57,447 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed 2018-05-02 06:26:57,459 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:26:57,463 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:26:57,465 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opened 299c3061e2a10cee5be3bff86a2ec41a; next sequenceid=417 2018-05-02 06:26:57,469 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened 51969dda9dfa8895c283f334f944e248; next sequenceid=417 2018-05-02 06:26:57,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/recovered.edits/411.seqid, newMaxSeqId=411, maxSeqId=410 2018-05-02 06:26:57,479 INFO [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:26:57,479 INFO [PostOpenDeployTasks:299c3061e2a10cee5be3bff86a2ec41a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:26:57,483 DEBUG [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:26:57,483 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:26:57,483 DEBUG [PostOpenDeployTasks:299c3061e2a10cee5be3bff86a2ec41a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:26:57,483 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:26:57,487 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened 19c6e3a27177cc57e6cf72ac907048ed; next sequenceid=411 2018-05-02 06:26:57,493 INFO [PostOpenDeployTasks:19c6e3a27177cc57e6cf72ac907048ed] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:26:57,498 DEBUG [PostOpenDeployTasks:19c6e3a27177cc57e6cf72ac907048ed] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:26:57,498 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:27:02,078 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:27:02,080 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:27:02,083 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:27:02,591 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:27:02,985 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:27:02,985 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:27:03,079 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:27:03,080 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:27:03,080 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:27:03,087 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:27:03,090 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:27:03,090 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:27:27,294 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.006 minutes, events=10, succcessCount=5, totalEvents=38, totalSuccessCount=19 2018-05-02 06:27:30,729 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:28:26,165 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 2018-05-02 06:28:26,169 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525241125281 znode expired, triggering replicatorRemoved event 2018-05-02 06:28:26,169 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:28:28,725 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:28:28,760 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:28:28,761 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opening region: {ENCODED => 8c7dd0ad2a67fa6a32d1f3694eef56eb, NAME => 'test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 06:28:28,761 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AuthenticationService 2018-05-02 06:28:28,762 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=SecureBulkLoadService 2018-05-02 06:28:28,762 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,762 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,762 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AccessControlService 2018-05-02 06:28:28,763 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,763 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:28:28,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:28:28,764 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,793 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:28:28,793 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:28:28,794 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,795 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,801 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:28:28,802 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:28:28,802 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:28:28,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opening region: {ENCODED => 51c9fc854cbebfa25ed419e23bd8ac74, NAME => 'test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 06:28:28,803 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opening region: {ENCODED => 7386aea828f5bbf6f2bb9358162092e6, NAME => 'test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:28:28,804 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AuthenticationService 2018-05-02 06:28:28,804 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:28:28,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 06:28:28,804 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AuthenticationService 2018-05-02 06:28:28,805 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,805 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,805 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=SecureBulkLoadService 2018-05-02 06:28:28,805 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,805 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,805 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AccessControlService 2018-05-02 06:28:28,805 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,805 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,806 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7386aea828f5bbf6f2bb9358162092e6 2018-05-02 06:28:28,806 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:28:28,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 06:28:28,806 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,806 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,806 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,806 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 06:28:28,807 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,807 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,807 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 06:28:28,807 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:28:28,807 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,808 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=SecureBulkLoadService 2018-05-02 06:28:28,808 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,808 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,808 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,809 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AccessControlService 2018-05-02 06:28:28,809 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,809 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,809 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 06:28:28,809 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:28:28,809 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,821 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opening region: {ENCODED => a0620fc83de532a37f6a9bb8f99cc6c4, NAME => 'test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 06:28:28,821 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AuthenticationService 2018-05-02 06:28:28,821 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,821 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=SecureBulkLoadService 2018-05-02 06:28:28,821 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,822 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,822 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,822 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. service=AccessControlService 2018-05-02 06:28:28,822 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,822 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,822 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 06:28:28,822 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:28:28,823 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,824 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:28:28,824 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:28:28,824 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:28:28,824 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:28:28,824 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:28:28,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 40744bb706fe10eab3c8964d0c6b003e, NAME => 'test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e.', STARTKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A', ENDKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4'} 2018-05-02 06:28:28,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => 8cb8f1e8202d0fae01b5300bd7c59bcb, NAME => 'test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb.', STARTKEY => '5\xE5\x0DyC^P\xD0', ENDKEY => '<\xA1\xAF(k\xCA\x1A\xEA'} 2018-05-02 06:28:28,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AuthenticationService 2018-05-02 06:28:28,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=AuthenticationService 2018-05-02 06:28:28,825 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,825 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=SecureBulkLoadService 2018-05-02 06:28:28,826 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,826 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,826 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,826 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. service=AccessControlService 2018-05-02 06:28:28,826 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,827 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => 735f841820ff0baa687bc402b169f4a6, NAME => 'test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:28:28,827 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 8cb8f1e8202d0fae01b5300bd7c59bcb 2018-05-02 06:28:28,827 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:28:28,827 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AuthenticationService 2018-05-02 06:28:28,827 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,827 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=SecureBulkLoadService 2018-05-02 06:28:28,827 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,827 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,827 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,825 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=SecureBulkLoadService 2018-05-02 06:28:28,828 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,828 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,828 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,827 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,828 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AccessControlService 2018-05-02 06:28:28,829 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,829 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,829 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 735f841820ff0baa687bc402b169f4a6 2018-05-02 06:28:28,829 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:28:28,829 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. service=AccessControlService 2018-05-02 06:28:28,830 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,830 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => 46af8f9145c39f07531ceaa92c7f8dbc, NAME => 'test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:28:28,830 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,831 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,830 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=AuthenticationService 2018-05-02 06:28:28,831 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,831 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=SecureBulkLoadService 2018-05-02 06:28:28,831 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,831 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,831 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,831 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=AccessControlService 2018-05-02 06:28:28,832 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,832 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,832 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 46af8f9145c39f07531ceaa92c7f8dbc 2018-05-02 06:28:28,832 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:28:28,832 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,833 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:28:28,833 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:28:28,834 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,884 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:28:28,884 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:28:28,885 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,886 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => 70ed82a86a0f0c62d692e8ffd1c0f904, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904.', STARTKEY => '\xF9C^P\xD7\x945\xC2', ENDKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF'} 2018-05-02 06:28:28,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=AuthenticationService 2018-05-02 06:28:28,891 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=SecureBulkLoadService 2018-05-02 06:28:28,891 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,891 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,891 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,895 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=AccessControlService 2018-05-02 06:28:28,895 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,895 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,896 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:28:28,896 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:28:28,899 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,900 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:28:28,901 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => 7b44edd79044515d04eb08298b1e52e9, NAME => 'test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:28:28,901 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AuthenticationService 2018-05-02 06:28:28,901 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,901 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=SecureBulkLoadService 2018-05-02 06:28:28,901 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,901 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,901 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,902 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AccessControlService 2018-05-02 06:28:28,902 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,902 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,902 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:28:28,902 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:28:28,902 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,919 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:28:28,920 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:28:28,921 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => d5e9f3919d5e95ad2d6e01e1e16fa8ad, NAME => 'test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad.', STARTKEY => 'yC^P\xD7\x945\xD4', ENDKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE'} 2018-05-02 06:28:28,922 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AuthenticationService 2018-05-02 06:28:28,922 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,922 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=SecureBulkLoadService 2018-05-02 06:28:28,922 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,922 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,922 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,922 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. service=AccessControlService 2018-05-02 06:28:28,922 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,922 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,923 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:28:28,923 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:28:28,923 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,923 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => 735c68afadbe039ceafe7e37c71a82b8, NAME => 'test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8.', STARTKEY => 'e\x0DyC^P\xD7\x86', ENDKEY => 'k\xCA\x1A\xF2\x86\xBC\xA1\xA0'} 2018-05-02 06:28:28,925 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=AuthenticationService 2018-05-02 06:28:28,925 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:28:28,925 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=SecureBulkLoadService 2018-05-02 06:28:28,925 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:28:28,925 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:28:28,925 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:28:28,925 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. service=AccessControlService 2018-05-02 06:28:28,925 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:28:28,929 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:28:28,929 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 735c68afadbe039ceafe7e37c71a82b8 2018-05-02 06:28:28,929 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:28:28,932 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:28:28,945 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 06:28:28,945 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 06:28:28,947 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 06:28:28,947 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 06:28:28,948 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,948 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,949 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,949 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,955 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 06:28:28,955 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf 2018-05-02 06:28:28,956 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,956 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,957 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1 2018-05-02 06:28:28,957 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1 2018-05-02 06:28:28,971 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,975 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:28,978 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1 2018-05-02 06:28:28,978 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1 2018-05-02 06:28:28,979 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:28,979 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:29,005 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:28:29,005 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:28:29,006 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:29,006 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:29,008 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 06:28:29,008 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1 2018-05-02 06:28:29,008 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:29,009 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:29,038 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:28:29,038 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:28:29,039 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:29,040 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:29,041 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 06:28:29,041 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1 2018-05-02 06:28:29,042 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:29,042 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:29,077 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1 2018-05-02 06:28:29,077 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1 2018-05-02 06:28:29,078 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:29,078 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:29,080 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1 2018-05-02 06:28:29,080 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1 2018-05-02 06:28:29,081 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:28:29,082 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:28:29,102 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf/003bd718e756495284dd200779f4eb8a 2018-05-02 06:28:29,102 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,122 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 06:28:29,122 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,142 DEBUG [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/test_cf/dae192f9264e44f1a0666db38941e7af 2018-05-02 06:28:29,142 INFO [StoreOpener-a0620fc83de532a37f6a9bb8f99cc6c4-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,145 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf/e84e460a6b1849daa9fe3dd7067bbe01 2018-05-02 06:28:29,145 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,175 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:28:29,176 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1/76ab8edd7657482f8dbe68fd37422b11 2018-05-02 06:28:29,176 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,184 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 06:28:29,190 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/60b42671ed6b409aaa6359fb0d738bd1 2018-05-02 06:28:29,226 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 06:28:29,226 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4 2018-05-02 06:28:29,227 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1/3f2d2f80200b4e7086e08019eff91a27 2018-05-02 06:28:29,234 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf/701b265951a9459fbb2a9068086da9e9 2018-05-02 06:28:29,234 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,314 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc 2018-05-02 06:28:29,328 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1/0064d3af25e44ea8b522aca7371d86e9 2018-05-02 06:28:29,328 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,335 DEBUG [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/f1/b7efbef765ea477fa322e685336bf3fd 2018-05-02 06:28:29,335 INFO [StoreOpener-d5e9f3919d5e95ad2d6e01e1e16fa8ad-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,415 DEBUG [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/f1/cf8ea72ad4194e3f960735c6f0ad0ee0 2018-05-02 06:28:29,415 INFO [StoreOpener-40744bb706fe10eab3c8964d0c6b003e-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,417 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6 2018-05-02 06:28:29,423 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1/8d2cf3534de147ed904b9fc82a8f2b3b 2018-05-02 06:28:29,423 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,445 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1/07854b903e5c4a14aab13c9789d93907 2018-05-02 06:28:29,446 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:28:29,450 DEBUG [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/f1/4fedc898e84f4979967e3b8666fea966 2018-05-02 06:28:29,450 INFO [StoreOpener-8cb8f1e8202d0fae01b5300bd7c59bcb-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,464 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e 2018-05-02 06:28:29,464 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad 2018-05-02 06:28:29,468 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/a3641d2c563f4968adf6f952315d6af8 2018-05-02 06:28:29,469 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,510 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:28:29,571 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb 2018-05-02 06:28:29,583 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12801.seqid, newMaxSeqId=12801, maxSeqId=12800 2018-05-02 06:28:29,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12303.seqid, newMaxSeqId=12303, maxSeqId=12302 2018-05-02 06:28:29,611 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12163.seqid, newMaxSeqId=12163, maxSeqId=12162 2018-05-02 06:28:29,618 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12895.seqid, newMaxSeqId=12895, maxSeqId=12894 2018-05-02 06:28:29,623 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opened 8c7dd0ad2a67fa6a32d1f3694eef56eb; next sequenceid=12801 2018-05-02 06:28:29,629 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opened 51c9fc854cbebfa25ed419e23bd8ac74; next sequenceid=12303 2018-05-02 06:28:29,637 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6 2018-05-02 06:28:29,650 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12163 2018-05-02 06:28:29,654 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opened a0620fc83de532a37f6a9bb8f99cc6c4; next sequenceid=12895 2018-05-02 06:28:29,665 DEBUG [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/f1/d9d7b3335aed4b73b1949214243017d7 2018-05-02 06:28:29,670 INFO [StoreOpener-735c68afadbe039ceafe7e37c71a82b8-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:28:29,671 INFO [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:28:29,671 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:28:29,674 INFO [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:28:29,675 DEBUG [PostOpenDeployTasks:a0620fc83de532a37f6a9bb8f99cc6c4] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:28:29,675 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,677 INFO [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:28:29,681 DEBUG [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:28:29,682 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,690 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:28:29,691 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12243.seqid, newMaxSeqId=12243, maxSeqId=12242 2018-05-02 06:28:29,706 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:28:29,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,707 DEBUG [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:28:29,707 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:28:29,717 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened 46af8f9145c39f07531ceaa92c7f8dbc; next sequenceid=417 2018-05-02 06:28:29,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:28:29,721 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:28:29,722 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened 735f841820ff0baa687bc402b169f4a6; next sequenceid=12243 2018-05-02 06:28:29,724 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8 2018-05-02 06:28:29,727 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened d5e9f3919d5e95ad2d6e01e1e16fa8ad; next sequenceid=414 2018-05-02 06:28:29,732 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 40744bb706fe10eab3c8964d0c6b003e; next sequenceid=414 2018-05-02 06:28:29,734 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened 7b44edd79044515d04eb08298b1e52e9; next sequenceid=417 2018-05-02 06:28:29,740 INFO [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:28:29,743 INFO [PostOpenDeployTasks:46af8f9145c39f07531ceaa92c7f8dbc] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:28:29,746 INFO [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:28:29,746 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:28:29,748 INFO [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:28:29,749 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:28:29,749 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:28:29,750 DEBUG [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:28:29,750 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,751 DEBUG [PostOpenDeployTasks:46af8f9145c39f07531ceaa92c7f8dbc] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:28:29,751 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,752 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opened 7386aea828f5bbf6f2bb9358162092e6; next sequenceid=414 2018-05-02 06:28:29,754 DEBUG [PostOpenDeployTasks:40744bb706fe10eab3c8964d0c6b003e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:28:29,754 INFO [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:28:29,754 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,757 INFO [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:28:29,759 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 8cb8f1e8202d0fae01b5300bd7c59bcb; next sequenceid=417 2018-05-02 06:28:29,759 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened 70ed82a86a0f0c62d692e8ffd1c0f904; next sequenceid=408 2018-05-02 06:28:29,762 DEBUG [PostOpenDeployTasks:d5e9f3919d5e95ad2d6e01e1e16fa8ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:28:29,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,762 DEBUG [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:28:29,762 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,763 DEBUG [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:28:29,763 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,764 INFO [PostOpenDeployTasks:70ed82a86a0f0c62d692e8ffd1c0f904] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:28:29,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:28:29,770 INFO [PostOpenDeployTasks:8cb8f1e8202d0fae01b5300bd7c59bcb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:28:29,773 DEBUG [PostOpenDeployTasks:70ed82a86a0f0c62d692e8ffd1c0f904] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:28:29,773 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,774 DEBUG [PostOpenDeployTasks:8cb8f1e8202d0fae01b5300bd7c59bcb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:28:29,774 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:29,776 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened 735c68afadbe039ceafe7e37c71a82b8; next sequenceid=417 2018-05-02 06:28:29,811 INFO [PostOpenDeployTasks:735c68afadbe039ceafe7e37c71a82b8] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:28:29,826 DEBUG [PostOpenDeployTasks:735c68afadbe039ceafe7e37c71a82b8] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:28:29,826 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:28:33,302 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:36.009 minutes, events=5, succcessCount=5, totalEvents=19, totalSuccessCount=19 2018-05-02 06:28:33,764 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:28:33,767 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:28:33,767 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:28:34,272 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:28:34,826 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:28:34,827 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:28:34,932 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:28:34,932 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:28:34,932 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:28:34,944 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:28:34,956 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:28:34,956 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:28:57,504 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:29:23,359 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 06:29:27,305 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.005 minutes, events=8, succcessCount=4, totalEvents=46, totalSuccessCount=23 2018-05-02 06:29:31,177 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:29:31,179 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:29:45,475 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd." 2018-05-02 06:29:45,497 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close dc953453430fbf031584084fad7c31bd, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:29:45,512 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:45,512 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing dc953453430fbf031584084fad7c31bd, disabling compactions & flushes 2018-05-02 06:29:45,513 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:29:45,602 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/recovered.edits/12692.seqid, newMaxSeqId=12692, maxSeqId=12690 2018-05-02 06:29:45,608 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:45,610 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:45,610 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:45,614 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:29:45,614 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding dc953453430fbf031584084fad7c31bd move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=12690 2018-05-02 06:29:45,627 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:29:46,378 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353." 2018-05-02 06:29:46,378 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 7d91c8087e31e21951799651a5262353, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:46,380 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\177\377\377\377\377\377\377\356,1525239890069.25414d6e395eadb383c40973693beb12." 2018-05-02 06:29:46,380 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:46,380 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 25414d6e395eadb383c40973693beb12, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:29:46,381 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 7d91c8087e31e21951799651a5262353, disabling compactions & flushes 2018-05-02 06:29:46,381 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:29:46,382 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:46,383 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 25414d6e395eadb383c40973693beb12, disabling compactions & flushes 2018-05-02 06:29:46,383 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:29:46,402 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=8 2018-05-02 06:29:46,415 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:46,415 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:46,415 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:46,415 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:29:46,415 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 7d91c8087e31e21951799651a5262353 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=8 2018-05-02 06:29:46,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:29:46,419 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:29:46,423 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:46,423 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:46,423 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:46,424 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:29:46,424 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 25414d6e395eadb383c40973693beb12 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=417 2018-05-02 06:29:46,426 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:29:47,404 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74." 2018-05-02 06:29:47,410 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 51c9fc854cbebfa25ed419e23bd8ac74, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:29:47,412 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,\232\362\206\274\241\257(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed." 2018-05-02 06:29:47,412 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 19c6e3a27177cc57e6cf72ac907048ed, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:47,412 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:47,412 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 51c9fc854cbebfa25ed419e23bd8ac74, disabling compactions & flushes 2018-05-02 06:29:47,412 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:29:47,412 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:47,413 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 19c6e3a27177cc57e6cf72ac907048ed, disabling compactions & flushes 2018-05-02 06:29:47,413 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:29:47,444 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:47,445 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12305.seqid, newMaxSeqId=12305, maxSeqId=12303 2018-05-02 06:29:47,448 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:47,448 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:47,448 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:47,448 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:29:47,448 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 19c6e3a27177cc57e6cf72ac907048ed move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=411 2018-05-02 06:29:47,450 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:47,450 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:47,450 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:47,450 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:29:47,450 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding 51c9fc854cbebfa25ed419e23bd8ac74 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=12303 2018-05-02 06:29:47,454 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:29:47,454 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:29:48,306 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=01:15.004 minutes, events=4, succcessCount=4, totalEvents=23, totalSuccessCount=23 2018-05-02 06:29:48,430 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\265\345\ryC^P\276,1525239890069.299c3061e2a10cee5be3bff86a2ec41a." 2018-05-02 06:29:48,430 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 299c3061e2a10cee5be3bff86a2ec41a, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230. Requested from /172.27.61.83 2018-05-02 06:29:48,431 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\336P\327\2245\345\rZ,1525239890069.3f499471b0415a38ad5efe046913cba2." 2018-05-02 06:29:48,431 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:48,432 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 3f499471b0415a38ad5efe046913cba2, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:29:48,432 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 299c3061e2a10cee5be3bff86a2ec41a, disabling compactions & flushes 2018-05-02 06:29:48,432 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:29:48,432 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:48,432 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 3f499471b0415a38ad5efe046913cba2, disabling compactions & flushes 2018-05-02 06:29:48,432 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:29:48,485 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:29:48,503 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:48,504 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:48,504 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:48,504 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:29:48,504 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 3f499471b0415a38ad5efe046913cba2 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=417 2018-05-02 06:29:48,509 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:29:48,513 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:29:48,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:48,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:48,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:48,523 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:29:48,523 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 299c3061e2a10cee5be3bff86a2ec41a move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230 record at close sequenceid=417 2018-05-02 06:29:48,531 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:29:49,228 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:29:49,229 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:29:49,236 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:29:49,656 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,\241\257(k\312\032\362p,1525241408832.e56a9c7383092895c06ee33b9b84d892." 2018-05-02 06:29:49,656 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close e56a9c7383092895c06ee33b9b84d892, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:29:49,657 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,\345\ryC^P\327t,1525241408832.b8144dc37f351e256653e1454207538f." 2018-05-02 06:29:49,657 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:49,657 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close b8144dc37f351e256653e1454207538f, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:29:49,663 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing e56a9c7383092895c06ee33b9b84d892, disabling compactions & flushes 2018-05-02 06:29:49,663 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:29:49,665 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:49,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing b8144dc37f351e256653e1454207538f, disabling compactions & flushes 2018-05-02 06:29:49,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:29:49,698 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e56a9c7383092895c06ee33b9b84d892/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:29:49,702 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:29:49,702 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:49,702 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:49,703 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:49,703 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:29:49,703 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding e56a9c7383092895c06ee33b9b84d892 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=408 2018-05-02 06:29:49,705 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:49,705 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA1\xAF(k\xCA\x1A\xF2p,1525241408832.e56a9c7383092895c06ee33b9b84d892. 2018-05-02 06:29:49,705 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:49,706 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:49,706 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:29:49,706 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding b8144dc37f351e256653e1454207538f move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=411 2018-05-02 06:29:49,707 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:29:49,753 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:29:50,047 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:29:50,047 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:29:50,222 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:29:50,222 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:29:50,222 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:29:50,227 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:29:50,230 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:29:50,230 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:29:50,483 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,\257(k\312\032\362\206\244,1525241408832.0fc1f394ae11e950c87a982abf7c1035." 2018-05-02 06:29:50,483 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 0fc1f394ae11e950c87a982abf7c1035, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:50,484 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb." 2018-05-02 06:29:50,484 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 8c7dd0ad2a67fa6a32d1f3694eef56eb, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:29:50,484 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:50,484 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 0fc1f394ae11e950c87a982abf7c1035, disabling compactions & flushes 2018-05-02 06:29:50,484 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:29:50,485 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:50,485 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 8c7dd0ad2a67fa6a32d1f3694eef56eb, disabling compactions & flushes 2018-05-02 06:29:50,485 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:29:50,515 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:29:50,520 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12803.seqid, newMaxSeqId=12803, maxSeqId=12801 2018-05-02 06:29:50,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:50,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:50,523 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:50,524 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:29:50,524 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 0fc1f394ae11e950c87a982abf7c1035 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=408 2018-05-02 06:29:50,526 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:50,526 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:50,526 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:50,526 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:29:50,527 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding 8c7dd0ad2a67fa6a32d1f3694eef56eb move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=12801 2018-05-02 06:29:50,527 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:29:50,531 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:29:50,807 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,\0245\345\ryC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334." 2018-05-02 06:29:50,808 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close fa24e8d8fdd999d38faae5dbf847c334, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:50,808 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:50,809 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing fa24e8d8fdd999d38faae5dbf847c334, disabling compactions & flushes 2018-05-02 06:29:50,809 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:29:50,835 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:29:50,844 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:50,844 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:50,844 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:50,845 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:29:50,845 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding fa24e8d8fdd999d38faae5dbf847c334 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=408 2018-05-02 06:29:50,848 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:29:51,923 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\320\327\2245\345\ry&,1525239890069.51969dda9dfa8895c283f334f944e248." 2018-05-02 06:29:51,923 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 51969dda9dfa8895c283f334f944e248, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:51,925 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\006\274\241\257(k\312\032,1525239890069.a97e624ee736c77fbc6ccefb3abbac31." 2018-05-02 06:29:51,925 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,925 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close a97e624ee736c77fbc6ccefb3abbac31, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:51,925 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 51969dda9dfa8895c283f334f944e248, disabling compactions & flushes 2018-05-02 06:29:51,926 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:29:51,928 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:51,928 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing a97e624ee736c77fbc6ccefb3abbac31, disabling compactions & flushes 2018-05-02 06:29:51,929 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:29:51,958 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:29:51,962 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,962 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a97e624ee736c77fbc6ccefb3abbac31/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:29:51,962 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,962 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,963 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:29:51,963 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 51969dda9dfa8895c283f334f944e248 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=417 2018-05-02 06:29:51,966 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:29:51,969 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:51,969 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:51,969 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:51,970 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:29:51,970 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding a97e624ee736c77fbc6ccefb3abbac31 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=417 2018-05-02 06:29:51,973 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x06\xBC\xA1\xAF(k\xCA\x1A,1525239890069.a97e624ee736c77fbc6ccefb3abbac31. 2018-05-02 06:29:52,243 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62." 2018-05-02 06:29:52,243 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 3bbeffd33dfc99ea8862c8eae819df62, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:29:52,244 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:52,245 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 3bbeffd33dfc99ea8862c8eae819df62, disabling compactions & flushes 2018-05-02 06:29:52,245 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:29:52,263 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12470.seqid, newMaxSeqId=12470, maxSeqId=12468 2018-05-02 06:29:52,266 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:52,266 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:52,266 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:52,266 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:29:52,266 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 3bbeffd33dfc99ea8862c8eae819df62 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=12468 2018-05-02 06:29:52,269 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:29:53,057 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538." 2018-05-02 06:29:53,058 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 60955ebb25dcf0aeb6d46e894a921538, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:53,059 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:53,059 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,r\206\274\241\257(k\272,1525239890069.7b44edd79044515d04eb08298b1e52e9." 2018-05-02 06:29:53,059 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 7b44edd79044515d04eb08298b1e52e9, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:29:53,059 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 60955ebb25dcf0aeb6d46e894a921538, disabling compactions & flushes 2018-05-02 06:29:53,059 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:29:53,059 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:53,059 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 7b44edd79044515d04eb08298b1e52e9, disabling compactions & flushes 2018-05-02 06:29:53,060 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:29:53,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:29:53,090 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/39.seqid, newMaxSeqId=39, maxSeqId=37 2018-05-02 06:29:53,090 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:53,090 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:53,090 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:53,090 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:29:53,091 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding 7b44edd79044515d04eb08298b1e52e9 move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=417 2018-05-02 06:29:53,094 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:53,094 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:53,094 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:53,094 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:29:53,094 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 60955ebb25dcf0aeb6d46e894a921538 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=37 2018-05-02 06:29:53,094 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:29:53,096 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:29:53,272 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951." 2018-05-02 06:29:53,272 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 1595f38ee901be7c67b997fe2fc95951, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:53,273 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:53,273 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 06:29:53,273 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:29:53,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11476.seqid, newMaxSeqId=11476, maxSeqId=11474 2018-05-02 06:29:53,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:53,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:53,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:53,290 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:29:53,290 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 1595f38ee901be7c67b997fe2fc95951 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=11474 2018-05-02 06:29:53,293 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:29:53,481 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 2018-05-02 06:29:53,488 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525241227391 znode expired, triggering replicatorRemoved event 2018-05-02 06:29:53,488 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:29:54,254 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:29:54,269 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:29:54,270 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => 93aea36f9251cfe49e28f84a517e3630, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:29:54,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AuthenticationService 2018-05-02 06:29:54,271 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,271 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=SecureBulkLoadService 2018-05-02 06:29:54,271 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,271 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,271 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AccessControlService 2018-05-02 06:29:54,272 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,272 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:29:54,272 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:29:54,273 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,292 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:29:54,292 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:29:54,293 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,293 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => c963eb77dbdc6dbab886dbe4eebba5ad, NAME => 'test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 06:29:54,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AuthenticationService 2018-05-02 06:29:54,294 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,294 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=SecureBulkLoadService 2018-05-02 06:29:54,294 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,294 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AccessControlService 2018-05-02 06:29:54,295 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,295 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 06:29:54,295 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:29:54,296 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,296 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:29:54,297 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opening region: {ENCODED => bb19a5bd59b1b3dff86020949234aaf5, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:29:54,298 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:29:54,301 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=AuthenticationService 2018-05-02 06:29:54,301 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=SecureBulkLoadService 2018-05-02 06:29:54,302 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,302 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,302 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=AccessControlService 2018-05-02 06:29:54,302 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,302 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:29:54,302 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:29:54,303 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,322 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:29:54,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => 24479666cac01319b99b1d0e11484b5c, NAME => 'test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c.', STARTKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V', ENDKEY => '\xA1\xAF(k\xCA\x1A\xF2p'} 2018-05-02 06:29:54,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=AuthenticationService 2018-05-02 06:29:54,323 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,323 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=SecureBulkLoadService 2018-05-02 06:29:54,323 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,323 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,323 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,324 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. service=AccessControlService 2018-05-02 06:29:54,324 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,324 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,324 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 24479666cac01319b99b1d0e11484b5c 2018-05-02 06:29:54,324 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:29:54,325 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,332 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 06:29:54,332 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 06:29:54,333 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,333 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,337 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1 2018-05-02 06:29:54,337 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1 2018-05-02 06:29:54,338 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,338 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,347 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/335c9d0ca00f43be9b2be1bdaf09a958 2018-05-02 06:29:54,359 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => 59a7b13a4cf2cd2376c378f77087088d, NAME => 'test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:29:54,360 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AuthenticationService 2018-05-02 06:29:54,360 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,360 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=SecureBulkLoadService 2018-05-02 06:29:54,360 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,360 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,360 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,360 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AccessControlService 2018-05-02 06:29:54,361 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,361 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,361 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:29:54,361 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:29:54,362 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,374 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:29:54,375 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:29:54,375 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1 2018-05-02 06:29:54,375 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1 2018-05-02 06:29:54,376 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:29:54,376 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:29:54,376 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:29:54,376 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:29:54,376 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:29:54,376 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:29:54,376 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:29:54,376 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,377 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:29:54,377 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,380 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => 3f187e06c01ee258024c3bcea437345b, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b.', STARTKEY => '\xB5\xE5\x0DyC^P\xBE', ENDKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8'} 2018-05-02 06:29:54,380 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=AuthenticationService 2018-05-02 06:29:54,380 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,380 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=SecureBulkLoadService 2018-05-02 06:29:54,380 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,380 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,380 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,381 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. service=AccessControlService 2018-05-02 06:29:54,381 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,381 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,381 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 3f187e06c01ee258024c3bcea437345b 2018-05-02 06:29:54,381 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:29:54,381 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,383 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opening region: {ENCODED => 166b9a4d8133a32343e23907c3228d62, NAME => 'test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62.', STARTKEY => '<\xA1\xAF(k\xCA\x1A\xEA', ENDKEY => 'C^P\xD7\x945\xE5\x04'} 2018-05-02 06:29:54,383 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=AuthenticationService 2018-05-02 06:29:54,384 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=SecureBulkLoadService 2018-05-02 06:29:54,384 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,384 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,384 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=AccessControlService 2018-05-02 06:29:54,384 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,384 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,385 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 166b9a4d8133a32343e23907c3228d62 2018-05-02 06:29:54,385 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:29:54,385 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,383 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:29:54,385 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opening region: {ENCODED => 9c4d77e622ed44a126e39f057f044750, NAME => 'test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750.', STARTKEY => '\xA1\xAF(k\xCA\x1A\xF2p', ENDKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A'} 2018-05-02 06:29:54,385 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 06:29:54,384 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opening region: {ENCODED => 63390c1b726b541c3ebd2a1a8679aaf1, NAME => 'test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:29:54,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=AuthenticationService 2018-05-02 06:29:54,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AuthenticationService 2018-05-02 06:29:54,386 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,386 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 06:29:54,386 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,386 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,386 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opening region: {ENCODED => bb80fda45cdcaf338a2a3cfb863adfc2, NAME => 'test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2.', STARTKEY => '70a3d701', ENDKEY => '7ae147a4'} 2018-05-02 06:29:54,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 06:29:54,387 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,386 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=SecureBulkLoadService 2018-05-02 06:29:54,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => b03e6835fbab67365568f0d2520e68de, NAME => 'test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de.', STARTKEY => '\x8DyC^P\xD7\x94"', ENDKEY => '\x945\xE5\x0DyC^<'} 2018-05-02 06:29:54,387 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,387 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,387 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=AuthenticationService 2018-05-02 06:29:54,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. service=AccessControlService 2018-05-02 06:29:54,387 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=SecureBulkLoadService 2018-05-02 06:29:54,387 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,388 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,387 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AuthenticationService 2018-05-02 06:29:54,388 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,388 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:29:54,388 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=SecureBulkLoadService 2018-05-02 06:29:54,388 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:29:54,388 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,388 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,388 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,388 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. service=AccessControlService 2018-05-02 06:29:54,388 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,388 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,388 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,389 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:29:54,389 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:29:54,389 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => bc0d9cf47453518915ae21d2cf637c18, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:29:54,390 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=AuthenticationService 2018-05-02 06:29:54,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => 1182d8ac9fbcff5334cd5fda2cf0c4a0, NAME => 'test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:29:54,390 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,390 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=SecureBulkLoadService 2018-05-02 06:29:54,390 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,390 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,390 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,390 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AuthenticationService 2018-05-02 06:29:54,390 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=AccessControlService 2018-05-02 06:29:54,390 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,391 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=SecureBulkLoadService 2018-05-02 06:29:54,391 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,391 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,391 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,386 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=SecureBulkLoadService 2018-05-02 06:29:54,391 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,391 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,391 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,391 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. service=AccessControlService 2018-05-02 06:29:54,391 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,391 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,392 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 9c4d77e622ed44a126e39f057f044750 2018-05-02 06:29:54,392 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:29:54,392 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,391 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,388 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,392 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. service=AccessControlService 2018-05-02 06:29:54,393 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,393 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,393 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am b03e6835fbab67365568f0d2520e68de 2018-05-02 06:29:54,393 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:29:54,393 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,388 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,394 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,394 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 06:29:54,394 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:29:54,394 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,387 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 931a5308337d39ab8fcac37d3a5e5844, NAME => 'test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 06:29:54,392 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AuthenticationService 2018-05-02 06:29:54,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AccessControlService 2018-05-02 06:29:54,396 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:29:54,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=SecureBulkLoadService 2018-05-02 06:29:54,396 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:29:54,391 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:29:54,396 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:29:54,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:29:54,396 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:29:54,396 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AccessControlService 2018-05-02 06:29:54,397 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,397 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:29:54,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:29:54,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 931a5308337d39ab8fcac37d3a5e5844 2018-05-02 06:29:54,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:29:54,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:29:54,397 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:29:54,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,397 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,399 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:54,456 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:29:54,456 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:29:54,458 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,459 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,473 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:29:54,473 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:29:54,474 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,475 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,483 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1/295233e1f4a34156ae67883afcf73774 2018-05-02 06:29:54,483 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,487 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:29:54,487 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf 2018-05-02 06:29:54,488 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1 2018-05-02 06:29:54,488 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1 2018-05-02 06:29:54,489 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,489 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,492 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1 2018-05-02 06:29:54,492 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1 2018-05-02 06:29:54,492 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,492 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,493 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1 2018-05-02 06:29:54,493 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1 2018-05-02 06:29:54,493 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,493 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 06:29:54,493 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf 2018-05-02 06:29:54,494 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,494 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,495 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,495 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,495 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1 2018-05-02 06:29:54,495 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1 2018-05-02 06:29:54,496 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,496 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1 2018-05-02 06:29:54,496 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1 2018-05-02 06:29:54,496 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,496 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,497 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,498 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/8cbf0c74e0754545a377c74c6bcdb70f 2018-05-02 06:29:54,498 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,500 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c 2018-05-02 06:29:54,500 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,503 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:29:54,503 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:29:54,504 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,505 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 06:29:54,505 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 06:29:54,505 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,505 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:29:54,506 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,510 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:29:54,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:29:54,567 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 06:29:54,570 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:29:54,574 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1/0acb18db6bda4706bbcda3af69f23a7f 2018-05-02 06:29:54,629 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 06:29:54,629 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,635 DEBUG [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/test_cf/e3adf874832040dc8950e8c8b53a24c3 2018-05-02 06:29:54,635 INFO [StoreOpener-63390c1b726b541c3ebd2a1a8679aaf1-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,642 DEBUG [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/test_cf/05473af1c5c04ce588cf168fef810af7 2018-05-02 06:29:54,643 INFO [StoreOpener-bb80fda45cdcaf338a2a3cfb863adfc2-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,659 DEBUG [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/f1/c96bbf08131a49779b97ac2c5c0843ad 2018-05-02 06:29:54,659 INFO [StoreOpener-24479666cac01319b99b1d0e11484b5c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,663 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf/8b3b68c170174446a4896b3d11e3b7ac 2018-05-02 06:29:54,663 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,666 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1/abd14eb0366d49d6b1f9c4e3beb7ea22 2018-05-02 06:29:54,666 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,666 DEBUG [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/f1/fc387eb319f242cba0384b0a240bb24d 2018-05-02 06:29:54,667 INFO [StoreOpener-9c4d77e622ed44a126e39f057f044750-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,676 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1/738c9260ad314f638f9a79ce7621a39e 2018-05-02 06:29:54,676 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,684 DEBUG [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/f1/fa1b12403a784e7a919dcbe2533a2a5f 2018-05-02 06:29:54,684 INFO [StoreOpener-3f187e06c01ee258024c3bcea437345b-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,685 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:29:54,690 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf/51d1fafd7fd44303b7556cecfd380615 2018-05-02 06:29:54,690 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,705 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:29:54,713 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf/ae5922ae05e649f79a208a0ea340ccb0 2018-05-02 06:29:54,720 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,720 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:29:54,725 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750 2018-05-02 06:29:54,732 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:29:54,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1 2018-05-02 06:29:54,742 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c 2018-05-02 06:29:54,746 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:29:54,746 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b 2018-05-02 06:29:54,748 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844 2018-05-02 06:29:54,750 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62 2018-05-02 06:29:54,753 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2 2018-05-02 06:29:54,760 DEBUG [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/f1/1aee01e3c8c44a4b8875ca610e35934d 2018-05-02 06:29:54,760 INFO [StoreOpener-b03e6835fbab67365568f0d2520e68de-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:29:54,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:29:54,774 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12247.seqid, newMaxSeqId=12247, maxSeqId=12246 2018-05-02 06:29:54,775 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de 2018-05-02 06:29:54,776 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:29:54,789 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened c963eb77dbdc6dbab886dbe4eebba5ad; next sequenceid=12247 2018-05-02 06:29:54,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:29:54,803 INFO [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:29:54,830 DEBUG [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:29:54,831 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,836 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opened bb19a5bd59b1b3dff86020949234aaf5; next sequenceid=408 2018-05-02 06:29:54,839 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:29:54,841 INFO [PostOpenDeployTasks:bb19a5bd59b1b3dff86020949234aaf5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:29:54,849 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened 93aea36f9251cfe49e28f84a517e3630; next sequenceid=414 2018-05-02 06:29:54,850 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13229.seqid, newMaxSeqId=13229, maxSeqId=13228 2018-05-02 06:29:54,850 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:29:54,852 INFO [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:29:54,857 DEBUG [PostOpenDeployTasks:bb19a5bd59b1b3dff86020949234aaf5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:29:54,857 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,859 DEBUG [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:29:54,859 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,864 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=13229 2018-05-02 06:29:54,864 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opened 9c4d77e622ed44a126e39f057f044750; next sequenceid=417 2018-05-02 06:29:54,865 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11533.seqid, newMaxSeqId=11533, maxSeqId=11532 2018-05-02 06:29:54,867 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:29:54,870 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12786.seqid, newMaxSeqId=12786, maxSeqId=12785 2018-05-02 06:29:54,871 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:29:54,880 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12462.seqid, newMaxSeqId=12462, maxSeqId=12461 2018-05-02 06:29:54,880 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:29:54,881 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12434.seqid, newMaxSeqId=12434, maxSeqId=12433 2018-05-02 06:29:54,881 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13650.seqid, newMaxSeqId=13650, maxSeqId=13649 2018-05-02 06:29:54,881 INFO [PostOpenDeployTasks:9c4d77e622ed44a126e39f057f044750] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:29:54,882 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opened 166b9a4d8133a32343e23907c3228d62; next sequenceid=417 2018-05-02 06:29:54,882 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opened 63390c1b726b541c3ebd2a1a8679aaf1; next sequenceid=11533 2018-05-02 06:29:54,883 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:29:54,884 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/recovered.edits/408.seqid, newMaxSeqId=408, maxSeqId=407 2018-05-02 06:29:54,884 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:29:54,885 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened 24479666cac01319b99b1d0e11484b5c; next sequenceid=417 2018-05-02 06:29:54,885 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:29:54,885 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opened bb80fda45cdcaf338a2a3cfb863adfc2; next sequenceid=12786 2018-05-02 06:29:54,885 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,886 DEBUG [PostOpenDeployTasks:9c4d77e622ed44a126e39f057f044750] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:29:54,886 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,888 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 931a5308337d39ab8fcac37d3a5e5844; next sequenceid=12462 2018-05-02 06:29:54,888 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened 59a7b13a4cf2cd2376c378f77087088d; next sequenceid=12434 2018-05-02 06:29:54,889 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened 1182d8ac9fbcff5334cd5fda2cf0c4a0; next sequenceid=13650 2018-05-02 06:29:54,890 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened 3f187e06c01ee258024c3bcea437345b; next sequenceid=408 2018-05-02 06:29:54,891 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened b03e6835fbab67365568f0d2520e68de; next sequenceid=417 2018-05-02 06:29:54,891 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened bc0d9cf47453518915ae21d2cf637c18; next sequenceid=408 2018-05-02 06:29:54,892 INFO [PostOpenDeployTasks:166b9a4d8133a32343e23907c3228d62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:29:54,892 INFO [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:29:54,896 DEBUG [PostOpenDeployTasks:166b9a4d8133a32343e23907c3228d62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:29:54,896 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,896 DEBUG [PostOpenDeployTasks:63390c1b726b541c3ebd2a1a8679aaf1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:29:54,896 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,902 INFO [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:29:54,902 INFO [PostOpenDeployTasks:24479666cac01319b99b1d0e11484b5c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:29:54,906 INFO [PostOpenDeployTasks:bc0d9cf47453518915ae21d2cf637c18] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:29:54,906 DEBUG [PostOpenDeployTasks:bb80fda45cdcaf338a2a3cfb863adfc2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:29:54,906 INFO [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:29:54,906 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,908 DEBUG [PostOpenDeployTasks:24479666cac01319b99b1d0e11484b5c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:29:54,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,908 INFO [PostOpenDeployTasks:3f187e06c01ee258024c3bcea437345b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:29:54,908 INFO [PostOpenDeployTasks:b03e6835fbab67365568f0d2520e68de] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:29:54,908 INFO [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:29:54,909 INFO [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:29:54,911 DEBUG [PostOpenDeployTasks:bc0d9cf47453518915ae21d2cf637c18] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:29:54,911 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,912 DEBUG [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:29:54,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,912 DEBUG [PostOpenDeployTasks:3f187e06c01ee258024c3bcea437345b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:29:54,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,912 DEBUG [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:29:54,912 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,912 DEBUG [PostOpenDeployTasks:b03e6835fbab67365568f0d2520e68de] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:29:54,913 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:54,913 DEBUG [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:29:54,913 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:29:55,237 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:29:55,613 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\032\362\206\274\241\257(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6." 2018-05-02 06:29:55,613 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 7386aea828f5bbf6f2bb9358162092e6, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:55,614 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\250k\312\032\362\206\274\212,1525239890069.40744bb706fe10eab3c8964d0c6b003e." 2018-05-02 06:29:55,614 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 40744bb706fe10eab3c8964d0c6b003e, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230. Requested from /172.27.61.83 2018-05-02 06:29:55,614 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:55,614 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 7386aea828f5bbf6f2bb9358162092e6, disabling compactions & flushes 2018-05-02 06:29:55,614 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:55,614 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:29:55,615 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 40744bb706fe10eab3c8964d0c6b003e, disabling compactions & flushes 2018-05-02 06:29:55,615 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:29:55,642 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:29:55,644 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/40744bb706fe10eab3c8964d0c6b003e/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:29:55,644 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:29:55,645 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:29:55,646 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:55,646 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:55,646 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:55,646 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:29:55,650 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:55,651 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding 7386aea828f5bbf6f2bb9358162092e6 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=414 2018-05-02 06:29:55,651 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:55,651 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:55,651 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:29:55,651 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 40744bb706fe10eab3c8964d0c6b003e move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230 record at close sequenceid=414 2018-05-02 06:29:55,663 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:29:55,664 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525239890069.40744bb706fe10eab3c8964d0c6b003e. 2018-05-02 06:29:55,735 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:29:55,735 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:29:55,735 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:29:55,743 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:29:55,746 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:29:55,746 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:29:56,630 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11." 2018-05-02 06:29:56,630 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close b5180eee96b616afdf79578309c66a11, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:56,631 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\274\241\257(k\312\032\330,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8." 2018-05-02 06:29:56,631 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 3b0ff50ae790418c1d7b36d704a3c7a8, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:56,631 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:56,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 06:29:56,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:29:56,631 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:56,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 3b0ff50ae790418c1d7b36d704a3c7a8, disabling compactions & flushes 2018-05-02 06:29:56,631 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:29:56,655 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12165.seqid, newMaxSeqId=12165, maxSeqId=12163 2018-05-02 06:29:56,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3b0ff50ae790418c1d7b36d704a3c7a8/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:29:56,660 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:56,660 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:56,660 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:56,660 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:29:56,660 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding b5180eee96b616afdf79578309c66a11 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=12163 2018-05-02 06:29:56,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:56,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:56,662 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:56,662 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:29:56,662 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding 3b0ff50ae790418c1d7b36d704a3c7a8 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=414 2018-05-02 06:29:56,663 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:29:56,664 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525239890069.3b0ff50ae790418c1d7b36d704a3c7a8. 2018-05-02 06:29:56,854 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4." 2018-05-02 06:29:56,854 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close a0620fc83de532a37f6a9bb8f99cc6c4, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:29:56,855 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:56,855 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing a0620fc83de532a37f6a9bb8f99cc6c4, disabling compactions & flushes 2018-05-02 06:29:56,855 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:29:56,875 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a0620fc83de532a37f6a9bb8f99cc6c4/recovered.edits/12897.seqid, newMaxSeqId=12897, maxSeqId=12895 2018-05-02 06:29:56,879 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:56,879 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:56,879 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:56,879 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:29:56,879 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding a0620fc83de532a37f6a9bb8f99cc6c4 move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=12895 2018-05-02 06:29:56,882 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,8f5c28ea,1525238855422.a0620fc83de532a37f6a9bb8f99cc6c4. 2018-05-02 06:29:57,774 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,r\206\274\241\257(k\272,1525241408832.bc0d9cf47453518915ae21d2cf637c18." 2018-05-02 06:29:57,775 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close bc0d9cf47453518915ae21d2cf637c18, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230. Requested from /172.27.61.83 2018-05-02 06:29:57,775 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:29:57,776 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing bc0d9cf47453518915ae21d2cf637c18, disabling compactions & flushes 2018-05-02 06:29:57,776 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:29:57,799 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:29:57,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:29:57,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:29:57,802 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:29:57,803 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:29:57,803 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding bc0d9cf47453518915ae21d2cf637c18 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230 record at close sequenceid=408 2018-05-02 06:29:57,808 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:30:00,646 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:30:00,647 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:30:00,649 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:30:01,153 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:30:01,251 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a." 2018-05-02 06:30:01,252 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 61e6bada2600d1326224ecb9ae7c237a, moving to ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983. Requested from /172.27.61.83 2018-05-02 06:30:01,252 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:01,253 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 06:30:01,253 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:30:01,268 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13231.seqid, newMaxSeqId=13231, maxSeqId=13229 2018-05-02 06:30:01,272 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:30:01,272 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:30:01,272 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:01,272 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:30:01,272 WARN [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Not adding moved region record: 61e6bada2600d1326224ecb9ae7c237a to self. 2018-05-02 06:30:01,274 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:30:01,540 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:30:01,540 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:30:01,601 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:30:01,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => 61e6bada2600d1326224ecb9ae7c237a, NAME => 'test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a.', STARTKEY => '851eb847', ENDKEY => '8f5c28ea'} 2018-05-02 06:30:01,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AuthenticationService 2018-05-02 06:30:01,615 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:30:01,615 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=SecureBulkLoadService 2018-05-02 06:30:01,615 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:30:01,615 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:30:01,615 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:30:01,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. service=AccessControlService 2018-05-02 06:30:01,616 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:30:01,616 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:30:01,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:30:01,616 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:30:01,617 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:01,618 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:30:01,618 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:30:01,618 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:30:01,624 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:30:01,627 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:30:01,627 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:30:01,636 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:30:01,636 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf 2018-05-02 06:30:01,637 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:30:01,637 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:30:01,675 DEBUG [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/test_cf/344746702cab4e3087c8267fbc018fb6 2018-05-02 06:30:01,675 INFO [StoreOpener-61e6bada2600d1326224ecb9ae7c237a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:30:01,681 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a 2018-05-02 06:30:01,696 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13232.seqid, newMaxSeqId=13232, maxSeqId=13231 2018-05-02 06:30:01,699 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened 61e6bada2600d1326224ecb9ae7c237a; next sequenceid=13232 2018-05-02 06:30:01,702 INFO [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:30:01,704 DEBUG [PostOpenDeployTasks:61e6bada2600d1326224ecb9ae7c237a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:30:01,705 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:30:02,060 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,<\241\257(k\312\032\352,1525239890069.166b9a4d8133a32343e23907c3228d62." 2018-05-02 06:30:02,061 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 166b9a4d8133a32343e23907c3228d62, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230. Requested from /172.27.61.83 2018-05-02 06:30:02,061 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:02,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 166b9a4d8133a32343e23907c3228d62, disabling compactions & flushes 2018-05-02 06:30:02,062 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:30:02,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:30:02,090 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:30:02,090 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:30:02,090 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:02,090 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:30:02,090 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding 166b9a4d8133a32343e23907c3228d62 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230 record at close sequenceid=417 2018-05-02 06:30:02,093 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:30:02,817 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am-namenode,\265\345\ryC^P\276,1525241408832.3f187e06c01ee258024c3bcea437345b." 2018-05-02 06:30:02,817 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 3f187e06c01ee258024c3bcea437345b, moving to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751. Requested from /172.27.61.83 2018-05-02 06:30:02,818 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:02,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 3f187e06c01ee258024c3bcea437345b, disabling compactions & flushes 2018-05-02 06:30:02,818 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:30:03,041 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/3f187e06c01ee258024c3bcea437345b/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:30:03,045 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:30:03,045 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:30:03,045 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:03,045 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:30:03,045 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 3f187e06c01ee258024c3bcea437345b move to ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751 record at close sequenceid=408 2018-05-02 06:30:03,048 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xB5\xE5\x0DyC^P\xBE,1525241408832.3f187e06c01ee258024c3bcea437345b. 2018-05-02 06:30:04,137 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad." 2018-05-02 06:30:04,138 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close c963eb77dbdc6dbab886dbe4eebba5ad, moving to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996. Requested from /172.27.61.83 2018-05-02 06:30:04,139 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:04,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing c963eb77dbdc6dbab886dbe4eebba5ad, disabling compactions & flushes 2018-05-02 06:30:04,139 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:30:04,169 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12249.seqid, newMaxSeqId=12249, maxSeqId=12247 2018-05-02 06:30:04,173 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:30:04,173 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:30:04,173 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:04,173 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:30:04,174 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionServer: Adding c963eb77dbdc6dbab886dbe4eebba5ad move to ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996 record at close sequenceid=12247 2018-05-02 06:30:04,176 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:30:05,756 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2." 2018-05-02 06:30:05,756 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close bb80fda45cdcaf338a2a3cfb863adfc2, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230. Requested from /172.27.61.83 2018-05-02 06:30:05,757 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:05,758 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing bb80fda45cdcaf338a2a3cfb863adfc2, disabling compactions & flushes 2018-05-02 06:30:05,758 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:30:05,772 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/bb80fda45cdcaf338a2a3cfb863adfc2/recovered.edits/12788.seqid, newMaxSeqId=12788, maxSeqId=12786 2018-05-02 06:30:05,775 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:30:05,775 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:30:05,775 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:05,776 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:30:05,776 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegionServer: Adding bb80fda45cdcaf338a2a3cfb863adfc2 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230 record at close sequenceid=12786 2018-05-02 06:30:05,778 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,70a3d701,1525238855422.bb80fda45cdcaf338a2a3cfb863adfc2. 2018-05-02 06:30:06,272 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:30:06,273 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:30:06,275 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:30:06,778 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:30:07,168 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:30:07,168 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:30:07,248 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:30:07,248 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:30:07,248 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:30:07,254 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:30:07,256 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:30:07,256 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:30:07,328 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: submitting region close type: REGION_NAME value: "test_hbase_ha_loadAndVerify_am,\241\257(k\312\032\362p,1525239890069.9c4d77e622ed44a126e39f057f044750." 2018-05-02 06:30:07,328 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Close 9c4d77e622ed44a126e39f057f044750, moving to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230. Requested from /172.27.61.83 2018-05-02 06:30:07,329 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:30:07,329 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 9c4d77e622ed44a126e39f057f044750, disabling compactions & flushes 2018-05-02 06:30:07,330 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:30:07,629 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/9c4d77e622ed44a126e39f057f044750/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:30:07,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:30:07,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:30:07,633 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:30:07,634 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:30:07,634 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegionServer: Adding 9c4d77e622ed44a126e39f057f044750 move to ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230 record at close sequenceid=417 2018-05-02 06:30:07,637 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xA1\xAF(k\xCA\x1A\xF2p,1525239890069.9c4d77e622ed44a126e39f057f044750. 2018-05-02 06:30:12,634 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:30:12,635 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:30:12,637 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:30:13,141 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:30:13,393 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:30:13,393 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:30:13,462 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:30:13,462 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:30:13,462 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:30:13,469 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:30:13,470 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:30:13,470 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:30:27,308 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.003 minutes, events=89, succcessCount=39, totalEvents=135, totalSuccessCount=62 2018-05-02 06:30:31,070 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:31:30,298 DEBUG [RS-EventLoopGroup-1-4] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:31:31,859 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:31:31,864 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:31:33,307 DEBUG [RS-EventLoopGroup-1-5] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000003.hwx.site/172.27.61.83:20000 2018-05-02 06:31:36,311 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:31:36,311 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:31:36,311 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:31:36,314 DEBUG [RS-EventLoopGroup-1-6] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:31:36,322 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:31:36,330 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:31:36,330 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:31:36,331 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:31:36,332 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:31:36,332 DEBUG [RS-EventLoopGroup-1-6] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:32:06,520 DEBUG [RS-EventLoopGroup-1-7] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:32:08,721 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:32:09,525 DEBUG [RS-EventLoopGroup-1-8] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:32:09,526 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: No master found; retry 2018-05-02 06:32:09,765 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:32:12,931 DEBUG [RS-EventLoopGroup-1-9] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:32:12,936 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:32:13,063 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:32:13,064 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:32:13,067 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:32:13,067 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:32:13,067 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf Wed May 2 06:32:39 UTC 2018 Terminating regionserver 2018-05-02 06:32:39,490 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:32:39,490 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:32:39,490 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:32:39,490 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:32:39,490 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:32:39,490 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:32:39,490 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:32:39,490 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:32:39,490 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 0 milli seconds 2018-05-02 06:32:39,490 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:32:39,490 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:32:39,490 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:32:39,490 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:32:39,490 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:32:39,491 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:32:39,491 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:32:39,491 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:32:39,491 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:32:39,491 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983' ***** 2018-05-02 06:32:39,491 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:32:39,491 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:32:39,491 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:32:39,491 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:32:39,492 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:32:39,492 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:32:39,492 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:32:39,492 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:32:39,492 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,492 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:32:39,492 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:32:39,492 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=02:51.186 minutes, events=39, succcessCount=39, totalEvents=62, totalSuccessCount=62 2018-05-02 06:32:39,492 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:32:39,492 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:32:39,492 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:32:39,493 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,493 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:32:39,493 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:32:39,493 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:32:39,493 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:32:39,493 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 exiting 2018-05-02 06:32:39,513 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:32:39,519 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] server.AbstractConnector: Stopped ServerConnector@7a4cf5f3{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:32:39,519 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:32:39,519 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:32:39,521 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:32:39,522 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:32:39,522 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:32:39,522 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:32:39,522 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:32:39,523 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,523 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,524 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,524 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,524 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,524 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing ce3059196e012fe2ffadcb5d2b348ce3, disabling compactions & flushes 2018-05-02 06:32:39,524 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:32:39,524 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 2fd8c4d5abf9928da8e8c547a0ca223a, disabling compactions & flushes 2018-05-02 06:32:39,524 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:32:39,525 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,526 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,526 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,526 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing b03e6835fbab67365568f0d2520e68de, disabling compactions & flushes 2018-05-02 06:32:39,526 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:32:39,526 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,527 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,527 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,527 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,528 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,528 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,529 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,529 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,529 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,530 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,530 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,530 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,531 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,531 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,531 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,531 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,533 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,533 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,533 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,534 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,536 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,537 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,537 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,537 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,538 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,538 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,538 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,539 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:32:39,539 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:32:39,539 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x557c7f56 to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:32:39,539 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:32:39,540 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 35 regions to close 2018-05-02 06:32:39,556 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12326.seqid, newMaxSeqId=12326, maxSeqId=12324 2018-05-02 06:32:39,559 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b03e6835fbab67365568f0d2520e68de/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:32:39,563 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12812.seqid, newMaxSeqId=12812, maxSeqId=12810 2018-05-02 06:32:39,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,567 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,568 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:32:39,568 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:32:39,568 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x8DyC^P\xD7\x94",1525239890069.b03e6835fbab67365568f0d2520e68de. 2018-05-02 06:32:39,568 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:32:39,568 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,568 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,569 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing a58d4c86d2df306cc460a231fd5a1ac1, disabling compactions & flushes 2018-05-02 06:32:39,569 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 931a5308337d39ab8fcac37d3a5e5844, disabling compactions & flushes 2018-05-02 06:32:39,569 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:32:39,569 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:32:39,571 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,571 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,571 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,571 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:32:39,571 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:32:39,571 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,572 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 1182d8ac9fbcff5334cd5fda2cf0c4a0, disabling compactions & flushes 2018-05-02 06:32:39,572 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:32:39,599 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12464.seqid, newMaxSeqId=12464, maxSeqId=12462 2018-05-02 06:32:39,603 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13652.seqid, newMaxSeqId=13652, maxSeqId=13650 2018-05-02 06:32:39,607 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:32:39,607 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,607 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,607 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,607 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:32:39,607 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:32:39,608 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,608 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 022c10bc256d7e8dc5d475d7ff8545ea, disabling compactions & flushes 2018-05-02 06:32:39,608 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:32:39,612 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,613 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:32:39,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:32:39,613 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,613 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 84c55bda386b9aa62a8b4df75ca9b38c, disabling compactions & flushes 2018-05-02 06:32:39,614 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:32:39,620 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,620 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,620 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,620 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:32:39,620 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:32:39,621 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,621 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 843b3b66a19c1c2d494720e99edc9c52, disabling compactions & flushes 2018-05-02 06:32:39,621 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:32:39,646 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:32:39,651 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/84c55bda386b9aa62a8b4df75ca9b38c/recovered.edits/11889.seqid, newMaxSeqId=11889, maxSeqId=11887 2018-05-02 06:32:39,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,657 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,658 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:32:39,658 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:32:39,658 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,658 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 7524beb6ac348dac037dbf298ba07495, disabling compactions & flushes 2018-05-02 06:32:39,658 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:32:39,664 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:32:39,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,665 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:32:39,665 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,ccccccbc,1525238855422.84c55bda386b9aa62a8b4df75ca9b38c. 2018-05-02 06:32:39,666 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,666 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 735f841820ff0baa687bc402b169f4a6, disabling compactions & flushes 2018-05-02 06:32:39,666 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:32:39,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,685 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:32:39,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:32:39,686 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,686 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 59a7b13a4cf2cd2376c378f77087088d, disabling compactions & flushes 2018-05-02 06:32:39,686 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:32:39,710 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12245.seqid, newMaxSeqId=12245, maxSeqId=12243 2018-05-02 06:32:39,715 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/7524beb6ac348dac037dbf298ba07495/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:32:39,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,719 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,719 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:32:39,720 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:32:39,720 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,720 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing d5e9f3919d5e95ad2d6e01e1e16fa8ad, disabling compactions & flushes 2018-05-02 06:32:39,721 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:32:39,723 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,723 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,723 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,723 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:32:39,723 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,5\xE5\x0DyC^P\xD0,1525241408832.7524beb6ac348dac037dbf298ba07495. 2018-05-02 06:32:39,724 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,724 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing a6e0d7561c4f19e78f94d37462588281, disabling compactions & flushes 2018-05-02 06:32:39,724 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:32:39,728 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12436.seqid, newMaxSeqId=12436, maxSeqId=12434 2018-05-02 06:32:39,738 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,738 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,738 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,738 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:32:39,738 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:32:39,739 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,739 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing f3db9f9879ed03f488dcb89bea834237, disabling compactions & flushes 2018-05-02 06:32:39,739 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:32:39,770 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/d5e9f3919d5e95ad2d6e01e1e16fa8ad/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:32:39,775 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/a6e0d7561c4f19e78f94d37462588281/recovered.edits/13478.seqid, newMaxSeqId=13478, maxSeqId=13476 2018-05-02 06:32:39,778 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,778 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,778 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,779 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:32:39,779 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,yC^P\xD7\x945\xD4,1525239890069.d5e9f3919d5e95ad2d6e01e1e16fa8ad. 2018-05-02 06:32:39,779 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,779 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 61e6bada2600d1326224ecb9ae7c237a, disabling compactions & flushes 2018-05-02 06:32:39,779 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:32:39,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,782 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,783 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:32:39,783 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,851eb847,1525237868269.a6e0d7561c4f19e78f94d37462588281. 2018-05-02 06:32:39,783 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,784 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 24479666cac01319b99b1d0e11484b5c, disabling compactions & flushes 2018-05-02 06:32:39,784 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:32:39,787 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3db9f9879ed03f488dcb89bea834237/recovered.edits/12083.seqid, newMaxSeqId=12083, maxSeqId=12081 2018-05-02 06:32:39,809 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,809 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,809 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,809 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:32:39,809 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,51eb8518,1525237868269.f3db9f9879ed03f488dcb89bea834237. 2018-05-02 06:32:39,810 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,810 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 93aea36f9251cfe49e28f84a517e3630, disabling compactions & flushes 2018-05-02 06:32:39,810 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:32:39,830 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/61e6bada2600d1326224ecb9ae7c237a/recovered.edits/13234.seqid, newMaxSeqId=13234, maxSeqId=13232 2018-05-02 06:32:39,834 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/24479666cac01319b99b1d0e11484b5c/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:32:39,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,840 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:32:39,840 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,851eb847,1525238855422.61e6bada2600d1326224ecb9ae7c237a. 2018-05-02 06:32:39,840 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 47377dfacc235cc247254a0eb8fe4f44, disabling compactions & flushes 2018-05-02 06:32:39,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:32:39,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,846 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:32:39,846 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x9A\xF2\x86\xBC\xA1\xAF(V,1525239890069.24479666cac01319b99b1d0e11484b5c. 2018-05-02 06:32:39,847 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,847 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 682775c01c8d957d744ae2b280c815cd, disabling compactions & flushes 2018-05-02 06:32:39,847 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:32:39,847 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:32:39,854 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,854 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,854 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,854 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:32:39,854 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:32:39,855 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,855 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 63390c1b726b541c3ebd2a1a8679aaf1, disabling compactions & flushes 2018-05-02 06:32:39,855 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:32:39,879 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/47377dfacc235cc247254a0eb8fe4f44/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:32:39,884 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/682775c01c8d957d744ae2b280c815cd/recovered.edits/12507.seqid, newMaxSeqId=12507, maxSeqId=12505 2018-05-02 06:32:39,891 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,891 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,892 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,892 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/63390c1b726b541c3ebd2a1a8679aaf1/recovered.edits/11535.seqid, newMaxSeqId=11535, maxSeqId=11533 2018-05-02 06:32:39,892 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:32:39,892 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,k\xCA\x1A\xF2\x86\xBC\xA1\xA0,1525241408832.47377dfacc235cc247254a0eb8fe4f44. 2018-05-02 06:32:39,892 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,893 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 8cb8f1e8202d0fae01b5300bd7c59bcb, disabling compactions & flushes 2018-05-02 06:32:39,893 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:32:39,896 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,896 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,896 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,897 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:32:39,897 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,c28f5c19,1525237868269.682775c01c8d957d744ae2b280c815cd. 2018-05-02 06:32:39,897 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,898 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 6e9424b67ac115dc3547de9b3eb4c5ef, disabling compactions & flushes 2018-05-02 06:32:39,898 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:32:39,899 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,899 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,899 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,899 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:32:39,899 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,3333332f,1525237868269.63390c1b726b541c3ebd2a1a8679aaf1. 2018-05-02 06:32:39,899 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,900 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing f3ccd3e0671152671071dbba3e2cb560, disabling compactions & flushes 2018-05-02 06:32:39,900 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:32:39,932 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/8cb8f1e8202d0fae01b5300bd7c59bcb/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:32:39,942 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,942 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,942 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,943 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:32:39,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,5\xE5\x0DyC^P\xD0,1525239890069.8cb8f1e8202d0fae01b5300bd7c59bcb. 2018-05-02 06:32:39,943 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,944 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing bb19a5bd59b1b3dff86020949234aaf5, disabling compactions & flushes 2018-05-02 06:32:39,944 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:32:39,947 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:32:39,952 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/f3ccd3e0671152671071dbba3e2cb560/recovered.edits/12802.seqid, newMaxSeqId=12802, maxSeqId=12800 2018-05-02 06:32:39,958 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,958 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,958 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,958 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:32:39,958 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:32:39,959 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing b52f5cecdefd18652f3e796b8dada29f, disabling compactions & flushes 2018-05-02 06:32:39,959 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:32:39,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:39,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:39,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:39,964 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:32:39,964 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,7ae147a4,1525237868269.f3ccd3e0671152671071dbba3e2cb560. 2018-05-02 06:32:39,964 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:39,965 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 70ed82a86a0f0c62d692e8ffd1c0f904, disabling compactions & flushes 2018-05-02 06:32:39,965 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:32:40,010 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:32:40,010 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/b52f5cecdefd18652f3e796b8dada29f/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:32:40,022 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,022 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,022 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,022 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,022 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,022 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,022 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:32:40,023 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:32:40,023 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:32:40,023 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E,1525239890069.b52f5cecdefd18652f3e796b8dada29f. 2018-05-02 06:32:40,023 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:40,023 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:40,023 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:32:40,023 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 46af8f9145c39f07531ceaa92c7f8dbc, disabling compactions & flushes 2018-05-02 06:32:40,023 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 084aa7d8a3bd4d7483494d5a2c39d5df, disabling compactions & flushes 2018-05-02 06:32:40,023 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:32:40,023 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:32:40,030 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,030 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,030 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,031 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:32:40,031 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:32:40,031 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:40,031 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 530aabaf92e988eadd5338ed38b9be0c, disabling compactions & flushes 2018-05-02 06:32:40,031 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:32:40,068 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12604.seqid, newMaxSeqId=12604, maxSeqId=12602 2018-05-02 06:32:40,079 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:32:40,086 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,087 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:32:40,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:32:40,087 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:32:40,087 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:40,088 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 45aba4505046246827a28b03d1c2611e, disabling compactions & flushes 2018-05-02 06:32:40,088 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:32:40,099 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,099 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,099 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,099 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:32:40,099 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:32:40,100 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:40,100 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 735c68afadbe039ceafe7e37c71a82b8, disabling compactions & flushes 2018-05-02 06:32:40,100 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:32:40,106 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,106 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,106 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,106 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:32:40,107 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:32:40,107 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:40,109 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 83a4166017315b69b94bd868d994447b, disabling compactions & flushes 2018-05-02 06:32:40,109 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:32:40,128 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:32:40,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,141 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:32:40,142 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:32:40,142 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:40,143 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 1fa0746104343e63d4a6c982f8a3bf32, disabling compactions & flushes 2018-05-02 06:32:40,143 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:32:40,151 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/735c68afadbe039ceafe7e37c71a82b8/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:32:40,157 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/83a4166017315b69b94bd868d994447b/recovered.edits/410.seqid, newMaxSeqId=410, maxSeqId=408 2018-05-02 06:32:40,164 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,164 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,164 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,165 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:32:40,165 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,e\x0DyC^P\xD7\x86,1525239890069.735c68afadbe039ceafe7e37c71a82b8. 2018-05-02 06:32:40,165 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:32:40,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 2e8da78a5421f95de8c75e0053e1d4a0, disabling compactions & flushes 2018-05-02 06:32:40,166 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:32:40,183 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,183 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,183 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,183 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:32:40,184 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x8DyC^P\xD7\x94",1525241408832.83a4166017315b69b94bd868d994447b. 2018-05-02 06:32:40,207 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/recovered.edits/413.seqid, newMaxSeqId=413, maxSeqId=411 2018-05-02 06:32:40,215 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/2e8da78a5421f95de8c75e0053e1d4a0/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:32:40,223 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,223 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,223 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,223 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:32:40,223 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:32:40,233 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:32:40,233 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:32:40,233 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:32:40,233 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:32:40,233 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x945\xE5\x0DyC^<,1525239890069.2e8da78a5421f95de8c75e0053e1d4a0. 2018-05-02 06:32:40,340 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983; all regions closed. 2018-05-02 06:32:40,341 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:32:40,409 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:32:40,409 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525242258983:(num 1525242274333) 2018-05-02 06:32:40,409 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:32:40,410 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Leases: Closed leases 2018-05-02 06:32:40,411 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 had [[ScheduledChore: Name: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactedHFilesCleaner Period: 120000 Unit: MILLISECONDS], [ScheduledChore: Name: MemstoreFlusherChore Period: 10000 Unit: MILLISECONDS], [ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:32:40,412 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:32:40,412 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:32:40,412 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:32:40,412 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:32:40,436 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.NettyRpcServer: Stopping server on /172.27.70.95:16020 2018-05-02 06:32:40,436 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:32:40,436 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 06:32:40,463 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983 2018-05-02 06:32:40,464 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x3631f08b27900bb, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:32:40,473 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:32:40,475 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ZooKeeper: Session: 0x3631f08b27900bb closed 2018-05-02 06:32:40,475 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983; zookeeper connection closed. 2018-05-02 06:32:40,476 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:32:40,501 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:33:48 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000002.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1031588 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:33:51,984 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:33:51,987 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:33:51,987 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:33:51,987 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:33:51,987 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:33:52,913 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:33:52,913 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:33:52,913 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:33:52,914 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:33:52,916 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:33:52,916 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:33:52,916 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:33:52,916 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:33:52,916 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:33:52,924 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:33:52,924 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:33:52,924 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:33:52,924 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:33:52,924 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:33:52,925 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:33:52,925 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:33:52,925 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:33:52,925 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:33:52,925 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:33:52,925 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:33:52,925 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:33:52,925 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:33:52,925 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:33:52,925 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:33:52,926 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:33:52,926 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:33:52,926 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:33:52,926 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020633 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:33:52,926 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:33:52,926 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:33:52,926 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:33:52,926 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log 2018-05-02 06:33:52,927 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:33:52,927 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:33:52,927 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:33:52,927 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:33:52,927 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=409596 2018-05-02 06:33:52,927 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:33:52,927 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:33:52,927 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:33:52,927 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:33:52,927 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:33:52,928 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:33:52,928 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:33:52,928 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:33:52,929 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:33:52,930 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020633 2018-05-02 06:33:52,930 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:33:52,931 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:33:52,931 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:33:52,931 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:33:52,934 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:33:52,934 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:33:52,935 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:33:52,935 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:33:52,935 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:33:52,938 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:33:52,939 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020633, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:33:53,304 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:33:54,367 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:33:54,501 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:33:55,497 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:33:55,508 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:33:56,651 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:33:56,651 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:33:56,651 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:33:56,937 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:33:57,468 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:33:57,468 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:33:57,522 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:33:58,341 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 server-side Connection retries=105 2018-05-02 06:33:58,365 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:33:58,368 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:33:58,368 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:33:58,368 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:33:58,374 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:33:58,375 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:33:58,650 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:33:59,026 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:33:59,048 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:33:59,213 INFO [main] ipc.NettyRpcServer: Bind to /172.27.70.95:16020 2018-05-02 06:33:59,834 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:33:59,844 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:33:59,851 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:33:59,903 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:59,911 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:33:59,931 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:34:02,885 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:34:02,906 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:34:03,009 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:34:03,023 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:34:03,023 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:34:03,023 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:34:03,023 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:34:03,023 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:34:03,023 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:34:03,025 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:34:03,025 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:34:03,025 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:34:03,025 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:34:03,025 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:34:03,025 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=4.15.12-1.el7.elrepo.x86_64 2018-05-02 06:34:03,025 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:34:03,025 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:34:03,025 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:34:03,027 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:34:03,087 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:34:03,096 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:34:03,130 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:34:03,130 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:34:03 UTC 2018 2018-05-02 06:34:03,131 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:34:03 UTC 2018 2018-05-02 06:34:03,131 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 02:52:58 UTC 2018 2018-05-02 06:34:03,160 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:34:03,220 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:34:03,233 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c010d, negotiated timeout = 90000 2018-05-02 06:34:03,237 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:34:03,238 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d connected 2018-05-02 06:34:03,278 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:34:03,400 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:34:03,400 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:34:03,400 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:34:03,400 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:34:03,400 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:34:03,400 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:34:03,400 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:34:03,400 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:34:03,401 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:34:03,401 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:34:03,401 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:34:03,401 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:34:03,407 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:03,638 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:34:03,695 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:34:03,696 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:34:03,736 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:34:03,829 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:34:04,015 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:34:04,016 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:34:04,016 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:34:04,059 INFO [main] util.log: Logging initialized @13777ms 2018-05-02 06:34:04,201 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:34:04,227 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:34:04,228 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:34:04,233 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:34:04,233 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:34:04,233 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:34:04,291 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:34:04,294 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:34:04,375 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:34:04,376 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:34:04,677 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:34:04,683 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000002.hwx.site,h=[ctr-e138-1518143905142-279227-01-000002.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:34:04,707 INFO [main] server.AbstractConnector: Started ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:34:04,707 INFO [main] server.Server: Started @14425ms 2018-05-02 06:34:04,750 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:34:04,759 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:34:04,811 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:34:04,811 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:34:04,820 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:34:04,902 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Connect 0x3ebca82d to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:34:04,924 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3ebca82d] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$38/1903466470@347617ac 2018-05-02 06:34:04,927 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3ebca82d-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:34:04,929 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3ebca82d-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:34:04,930 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3ebca82d-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, initiating session 2018-05-02 06:34:04,934 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3ebca82d-SendThread(ctr-e138-1518143905142-279227-01-000008.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000008.hwx.site/172.27.69.22:2181, sessionid = 0x3631f08b27900c9, negotiated timeout = 90000 2018-05-02 06:34:05,024 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e9d7a37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:34:05,027 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@292a9bd4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:0 2018-05-02 06:34:05,037 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000002:16020 2018-05-02 06:34:05,064 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:34:05,065 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:34:05,091 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:34:05,091 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:34:05,091 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:34:05,091 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:34:05,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:34:05,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:34:05,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:34:05,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:34:05,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:34:05,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:34:05,092 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:34:05,093 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:34:05,407 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:34:05,421 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:34:05,426 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:34:05,426 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:34:05,431 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:34:05,431 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:34:05,486 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:34:05,487 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:34:05,499 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:34:05,500 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:34:05,500 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:34:05,500 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:34:05,500 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:34:05,500 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:34:05,501 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:34:05,501 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:34:05,501 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:34:05,511 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:34:05,512 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:34:05,512 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:34:05,512 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:34:05,560 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:34:05,605 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:34:05,606 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:34:05,607 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:34:05,607 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:34:05,607 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:34:05,607 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:34:05,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:34:05,615 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:34:05,615 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:34:05,615 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:34:05,615 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:34:05,615 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:34:05,615 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:34:05,615 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:34:05,615 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:34:05,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:34:05,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:34:05,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:34:05,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:34:05,616 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:34:05,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:34:05,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:34:05,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:34:05,618 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:34:05,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:34:05,619 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:34:05,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:34:05,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:34:05,620 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:34:05,621 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:34:05,621 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:34:05,621 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:34:05,622 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:34:05,627 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:34:05,665 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:34:05,668 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:34:06,050 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:34:06,500 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:34:07,516 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:34:07,521 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:34:10,195 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:34:10,523 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:34:10,523 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:34:10,524 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:34:10,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:34:10,532 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:34:10,562 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000003.hwx.site,20000,1525242722107 with port=16020, startcode=1525242833009 2018-05-02 06:34:10,808 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:34:10,808 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:34:10,810 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:34:11,048 DEBUG [RS-EventLoopGroup-1-2] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:34:11,084 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:34:11,152 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:34:11,155 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:34:11,157 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:34:11,158 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:34:11,158 DEBUG [RS-EventLoopGroup-1-2] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:34:11,272 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:34:11,272 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:34:11,273 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:34:11,516 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:34:11,574 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:12,047 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:34:12,083 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:34:12,154 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:34:12,183 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:34:12,191 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:34:12,231 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:34:12,298 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:34:12,299 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:34:12,299 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:34:12,299 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:34:12,299 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:34:12,300 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:34:12,300 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:34:12,304 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:34:12,394 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 starting 2018-05-02 06:34:12,395 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:34:12,401 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:34:12,407 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:34:12,408 DEBUG [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] coordination.ZkSplitLogWorkerCoordination: Current region server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-02 06:34:12,416 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:34:12,421 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:34:12,445 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242352230, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242258983, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242527751, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009] other RSs: [ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009] 2018-05-02 06:34:12,498 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] coordination.ZkSplitLogWorkerCoordination: worker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 acquired task /hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896-splitting%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%252C16020%252C1525242616896.meta.1525242791617.meta 2018-05-02 06:34:12,638 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009, RpcServer on ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:16020, sessionid=0x1631f08b26c010d 2018-05-02 06:34:12,638 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:34:12,638 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:12,638 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009' 2018-05-02 06:34:12,638 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:34:12,642 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:34:12,645 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:34:12,645 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:34:12,645 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:12,645 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009' 2018-05-02 06:34:12,645 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:34:12,646 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:34:12,647 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:34:12,647 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:34:12,649 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:34:12,821 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Splitting WAL=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896-splitting/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.meta.1525242791617.meta, length=106750 2018-05-02 06:34:12,828 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896-splitting%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%252C16020%252C1525242616896.meta.1525242791617.meta 2018-05-02 06:34:12,830 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] util.FSHDFSUtils: Recover lease on dfs file hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896-splitting/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.meta.1525242791617.meta 2018-05-02 06:34:12,844 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] util.FSHDFSUtils: Recovered lease, attempt=0 on file=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896-splitting/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.meta.1525242791617.meta after 14ms 2018-05-02 06:34:14,057 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: DLS Last flushed sequenceid for 1588230740: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "info" sequence_id: 2740 } store_sequence_id { family_name: "table" sequence_id: 18446744073709551615 } 2018-05-02 06:34:14,472 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Finishing writing output logs and closing down 2018-05-02 06:34:14,472 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Waiting for split writer threads to finish 2018-05-02 06:34:14,556 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0-Writer-2] wal.WALSplitter: Creating writer path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/0000000000000002741-ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.meta.1525242791617.meta.temp 2018-05-02 06:34:14,802 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: 3 split writers finished; closing. 2018-05-02 06:34:14,955 DEBUG [split-log-closeStream-1] wal.WALSplitter: Closed wap hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/0000000000000002741-ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.meta.1525242791617.meta.temp (wrote 151 edits, skipped 0 edits in 728ms 2018-05-02 06:34:15,010 INFO [split-log-closeStream-1] wal.WALSplitter: Rename hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/0000000000000002741-ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.meta.1525242791617.meta.temp to hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/0000000000000002891 2018-05-02 06:34:15,016 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Processed 151 edits across 1 regions; edits skipped=4; log file=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896-splitting/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.meta.1525242791617.meta, length=106750, corrupted=false, progress failed=false 2018-05-02 06:34:15,021 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896-splitting%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%252C16020%252C1525242616896.meta.1525242791617.meta 2018-05-02 06:34:15,021 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coordination.ZkSplitLogWorkerCoordination: successfully transitioned task /hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896-splitting%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%252C16020%252C1525242616896.meta.1525242791617.meta to final state DONE ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:15,022 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.WALSplitterHandler: Worker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 done with task org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination$ZkSplitTaskDetails@347b1409 in 2486ms. Status = DONE 2018-05-02 06:34:15,064 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 06:34:15,946 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525242833009, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:34:16,052 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525242833009.1525242855946 2018-05-02 06:34:16,052 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK]] 2018-05-02 06:34:16,358 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:34:16,363 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:34:16,364 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:16,374 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:34:16,391 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:16,396 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:34:16,398 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:16,399 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:34:16,400 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:34:16,548 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:meta,,1.1588230740 2018-05-02 06:34:16,554 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:34:16,572 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525242833009.meta, suffix=.meta, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:34:16,709 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525242833009.meta.1525242856572.meta 2018-05-02 06:34:16,709 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:34:16,719 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:34:16,824 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AuthenticationService 2018-05-02 06:34:16,827 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:16,832 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=SecureBulkLoadService 2018-05-02 06:34:16,832 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:16,832 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:16,833 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:16,833 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2018-05-02 06:34:16,834 WARN [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:16,834 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:16,840 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2018-05-02 06:34:16,844 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2018-05-02 06:34:16,847 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.RegionCoprocessorHost: Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2018-05-02 06:34:16,878 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table meta 1588230740 2018-05-02 06:34:16,879 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated hbase:meta,,1.1588230740 2018-05-02 06:34:17,045 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 06:34:17,065 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info 2018-05-02 06:34:17,129 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:17,158 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:17,438 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/608674def2b442d49e864e4c9256f9b8 2018-05-02 06:34:17,505 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:34:17,505 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 06:34:17,565 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/d45d8a90947747948c7ad2c68791e902 2018-05-02 06:34:17,574 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:17,586 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 06:34:17,586 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table 2018-05-02 06:34:17,589 INFO [StoreOpener-1588230740-1] hfile.CacheConfig: Created cacheConfig for table: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:17,590 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:17,622 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:34:17,622 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 06:34:17,622 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 06:34:17,622 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2018-05-02 06:34:17,624 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:34:17,624 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 06:34:17,652 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:34:17,709 DEBUG [StoreOpener-1588230740-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/table/1c4610df23af45aebb0c862393f196e4 2018-05-02 06:34:17,709 INFO [StoreOpener-1588230740-1] regionserver.HStore: Store=table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:17,745 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 1 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740 2018-05-02 06:34:17,758 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Replaying edits from hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/0000000000000002891 2018-05-02 06:34:17,879 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: 1588230740 : Replaying compaction marker table_name: "hbase:meta" encoded_region_name: "1588230740" family_name: "info" compaction_input: "8169341d68cd4062b78ea05353d96adb" compaction_input: "05aaed4155904938b4506f41d91511af" compaction_input: "d94dbfd81b8f43fe9bc92ec544ae2409" compaction_output: "608674def2b442d49e864e4c9256f9b8" store_home_dir: "info" region_name: "hbase:meta,,1" with seqId=9223372036854775807 and lastReplayedOpenRegionSeqId=-1 2018-05-02 06:34:17,882 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Completing compaction from the WAL marker 2018-05-02 06:34:17,926 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Applied 0, skipped 601, firstSequenceIdInLog=2741, maxSequenceIdInLog=2891, path=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/0000000000000002891 2018-05-02 06:34:18,292 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Deleted recovered.edits file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/0000000000000002891 2018-05-02 06:34:18,314 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.FlushLargeStoresPolicy: No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (32.0M)) instead. 2018-05-02 06:34:18,379 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/2896.seqid, newMaxSeqId=2896, maxSeqId=2895 2018-05-02 06:34:18,390 INFO [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 1588230740; next sequenceid=2896 2018-05-02 06:34:18,425 INFO [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Post open deploy tasks for hbase:meta,,1.1588230740 2018-05-02 06:34:18,507 DEBUG [PostOpenDeployTasks:1588230740] regionserver.HRegionServer: Finished post open deploy task for hbase:meta,,1.1588230740 2018-05-02 06:34:18,510 DEBUG [RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened hbase:meta,,1.1588230740 on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:18,580 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 06:34:18,583 DEBUG [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] coordination.ZkSplitLogWorkerCoordination: Current region server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 is ready to take more tasks, will get task list and try grab tasks again. 2018-05-02 06:34:18,587 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] coordination.ZkSplitLogWorkerCoordination: worker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 acquired task /hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896-splitting%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%252C16020%252C1525242616896.1525242635223 2018-05-02 06:34:18,642 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Splitting WAL=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896-splitting/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.1525242635223, length=109612 2018-05-02 06:34:18,646 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896-splitting%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%252C16020%252C1525242616896.1525242635223 2018-05-02 06:34:18,647 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] util.FSHDFSUtils: Recover lease on dfs file hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896-splitting/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.1525242635223 2018-05-02 06:34:18,652 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] util.FSHDFSUtils: Recovered lease, attempt=0 on file=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896-splitting/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.1525242635223 after 5ms 2018-05-02 06:34:18,736 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 735f841820ff0baa687bc402b169f4a6: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,744 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 45aba4505046246827a28b03d1c2611e: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,752 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 46af8f9145c39f07531ceaa92c7f8dbc: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,761 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 931a5308337d39ab8fcac37d3a5e5844: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,772 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 83a4166017315b69b94bd868d994447b: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,778 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for f3ccd3e0671152671071dbba3e2cb560: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,782 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 70ed82a86a0f0c62d692e8ffd1c0f904: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,796 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 8cb8f1e8202d0fae01b5300bd7c59bcb: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,823 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for b03e6835fbab67365568f0d2520e68de: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,838 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 843b3b66a19c1c2d494720e99edc9c52: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,845 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 530aabaf92e988eadd5338ed38b9be0c: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,858 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 24479666cac01319b99b1d0e11484b5c: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,865 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 4c37ee7a4e1210e481debdc2933fc4d2: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,878 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 36261edb1d6e5ae1d91cf96e60680ebc: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,892 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a0792481dc7d859b1b63b04bf9adad81: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,901 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for b7a376d86459306e108ed5a76373661f: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,908 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for e8edde5a00b30c080b02d1b096794b39: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,915 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 84e1f06e5813d24f1cc300fb32167710: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,919 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 166b9a4d8133a32343e23907c3228d62: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,924 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 041977f7087dd987f3bc1c3b0d191155: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,932 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for f0e2ef89aaf5b6c921cae75dc420616f: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,936 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 9c4d77e622ed44a126e39f057f044750: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,940 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 5fc7cfd582bc270c530fe9787011078c: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,943 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 3bbeffd33dfc99ea8862c8eae819df62: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,949 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 963add1708f89627737d4d216f3449df: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,953 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for cb06832d0afac8a9bdbe1f92ad565ab6: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,957 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 6cfc24cc3a423e0969138ce2a69be99e: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,962 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 6e9424b67ac115dc3547de9b3eb4c5ef: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,966 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a8ff96226d546f0ea151823ae73e5a1b: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,970 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 385c8f00672f754fa0d7448f5ac543fa: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,974 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 670f6b815d2acac905130e5440d59304: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,978 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for da9e02fc1fdd80392463141e6bc6cf96: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,990 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 682775c01c8d957d744ae2b280c815cd: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:18,998 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for cdf5d5c10fe0b7d279387a401c3754ca: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,004 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for b52f5cecdefd18652f3e796b8dada29f: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,013 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 5de3546305c82231844eb840c6cfa983: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,017 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 8ac6e5d607af84df53c95bd38a03c313: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,024 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 2fd8c4d5abf9928da8e8c547a0ca223a: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,027 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for b32f7e3b20e736fd1681093bef6b435d: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,033 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for dc953453430fbf031584084fad7c31bd: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,036 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for b91e4798ff3d5547c13242b7b77e2f63: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,040 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 84c55bda386b9aa62a8b4df75ca9b38c: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,047 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for b8144dc37f351e256653e1454207538f: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,053 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for bb80fda45cdcaf338a2a3cfb863adfc2: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,056 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 084aa7d8a3bd4d7483494d5a2c39d5df: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,062 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 28608f50f9f828e7d3ab571a72b0d5f3: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,066 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 26d4b78c3c7d2fdea4d32bb21a3ca5fe: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,071 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 1bf9126ca1d7eb9abb934165d5f25857: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,075 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 78e8a528d65332a4f7661e8ab427a827: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,078 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 51c9fc854cbebfa25ed419e23bd8ac74: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,081 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 299ab8318d1b1d267135f988608683b7: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,085 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for bb19a5bd59b1b3dff86020949234aaf5: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,088 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for c963eb77dbdc6dbab886dbe4eebba5ad: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,090 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 1fa0746104343e63d4a6c982f8a3bf32: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,093 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for ab4e529620b9089675ab2d6f3446a39c: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,096 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 3ea52812fafc49b1651e26e1bd43ec97: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,099 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 51119cebc42546d1c9f2590eec5a49b3: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,102 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 735c68afadbe039ceafe7e37c71a82b8: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,104 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for f61045f3bb8866c33d9b05635d777d75: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,110 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 29fe0b7866912efc70bb3f2d7fd83059: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,113 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 1182d8ac9fbcff5334cd5fda2cf0c4a0: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,117 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for ffde9f4a59ab08d4830f3b671f736ad5: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,120 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a28a981dbde91491f904c000efc74ecb: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,123 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 5c3fc4872d744c7bdc4c539ee55dc094: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,126 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for bae4cdead31e3a4da5b719f67722e3d8: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,135 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 94f6ca283dbb4445b2bcdc321b734d28: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,139 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 91f73e76bbe7bc8a61b1b1299d34c6ab: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,142 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 0fc1f394ae11e950c87a982abf7c1035: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,147 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 5bd8c2cd29520d0d27cacb48e7436a6d: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,152 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for c078deb2474e9c19b85b5fdb9efaa47d: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,157 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 3b0ff50ae790418c1d7b36d704a3c7a8: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,161 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for b89f4262e34dfdd1fbea3661f9d50263: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "l" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,165 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 7b44edd79044515d04eb08298b1e52e9: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,171 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for e75a388bc2011feed75bdc1a0e99a9a9: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,175 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 3f187e06c01ee258024c3bcea437345b: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,178 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for ce3059196e012fe2ffadcb5d2b348ce3: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,181 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 8dc6fd2022c2fdf8c065fbd16cadaaca: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "dt" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,184 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a0620fc83de532a37f6a9bb8f99cc6c4: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,187 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 60955ebb25dcf0aeb6d46e894a921538: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "info" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,190 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 47c574242e461d8e7a12972718bc27ff: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,193 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 681566c13ee68fa7a27c4bd39d5a79e0: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,197 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for d5e9f3919d5e95ad2d6e01e1e16fa8ad: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,204 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 59a7b13a4cf2cd2376c378f77087088d: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,209 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 61e6bada2600d1326224ecb9ae7c237a: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,215 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 411bd5dbc3845cf91c0d9f4649c84b86: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,223 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for bc0d9cf47453518915ae21d2cf637c18: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,232 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a6e0d7561c4f19e78f94d37462588281: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,251 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 3ca34b6bdc72922097d54ce260dbd903: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,255 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 8c7dd0ad2a67fa6a32d1f3694eef56eb: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,261 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 1595f38ee901be7c67b997fe2fc95951: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,266 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 98abf1ead3bf61c95cc4ffe5e6e5fe96: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,270 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 9f9b6704233f2d2e06a5634fda7f94ca: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,280 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 022c10bc256d7e8dc5d475d7ff8545ea: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,285 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 2859fac3bc772763b3fd1621c2669f2b: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,293 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a47cc34ca47759b3fd7bcaa79faebd3d: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,300 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for b5180eee96b616afdf79578309c66a11: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,304 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 7386aea828f5bbf6f2bb9358162092e6: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,311 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 299c3061e2a10cee5be3bff86a2ec41a: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,316 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 25414d6e395eadb383c40973693beb12: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,323 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 960276b77c021b3663429298ac0cccd7: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,327 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for f3db9f9879ed03f488dcb89bea834237: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,329 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a58d4c86d2df306cc460a231fd5a1ac1: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,331 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 32b24a1d0ec05868d69a34a41559e784: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,334 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 41c625158570994727f1c92a8606ca6c: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,338 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a1d694475a6981010a6489a33c4db464: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,341 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a97e624ee736c77fbc6ccefb3abbac31: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,346 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 9c38689b653a37956f2ae7364b126f1b: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,350 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 1d954f21d711345a9587d995cecea136: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,373 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for e56a9c7383092895c06ee33b9b84d892: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,384 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 19c6e3a27177cc57e6cf72ac907048ed: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,388 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 2e8da78a5421f95de8c75e0053e1d4a0: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,392 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 665f3f34ec072c60acee3dc78af73b62: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,395 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 40744bb706fe10eab3c8964d0c6b003e: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,398 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for e1d84fe7eb9adbf61fec50c75876bce8: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,403 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 51969dda9dfa8895c283f334f944e248: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,407 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 89df5caac424c7424fede4183c6dce19: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,412 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for b9be42c9bb7b350e67325f3e6a3a59fb: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,416 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a3403d29839e289caca7a1e3c5cd71be: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,427 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 93a15c4ca6299bea02a86ac40494d75a: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,436 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 7d91c8087e31e21951799651a5262353: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,440 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 63390c1b726b541c3ebd2a1a8679aaf1: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,453 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 685781049fdcc89efe3561b69e4d3810: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,462 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 7524beb6ac348dac037dbf298ba07495: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,465 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for aa977fc80ff408457e9257d2ab7afdf2: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "test_cf" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,468 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for bcf3e62f0ae8e672bee1318720d62930: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,496 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for a6d67b9eb3447b55a82b542d202ddd20: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,502 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 93f2d602c0a0a654856fb16863c2ff38: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,508 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 54c783f1faee76bcce84aee6145e82d1: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,512 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 3f499471b0415a38ad5efe046913cba2: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,524 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 47377dfacc235cc247254a0eb8fe4f44: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,530 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for fa24e8d8fdd999d38faae5dbf847c334: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,539 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 93aea36f9251cfe49e28f84a517e3630: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,543 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 5080f353428ccd74e13d5b5493533655: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "e" sequence_id: 18446744073709551615 } store_sequence_id { family_name: "f" sequence_id: 18446744073709551615 } store_sequence_id { family_name: "g" sequence_id: 18446744073709551615 } store_sequence_id { family_name: "h" sequence_id: 18446744073709551615 } store_sequence_id { family_name: "i" sequence_id: 18446744073709551615 } store_sequence_id { family_name: "l" sequence_id: 18446744073709551615 } store_sequence_id { family_name: "m" sequence_id: 18446744073709551615 } store_sequence_id { family_name: "s" sequence_id: 18446744073709551615 } store_sequence_id { family_name: "t" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,551 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: DLS Last flushed sequenceid for 298977e880ecf479f4c50be95a5e8eb5: last_flushed_sequence_id: 18446744073709551615 store_sequence_id { family_name: "f1" sequence_id: 18446744073709551615 } 2018-05-02 06:34:19,602 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Finishing writing output logs and closing down 2018-05-02 06:34:19,602 DEBUG [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Waiting for split writer threads to finish 2018-05-02 06:34:19,609 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: 3 split writers finished; closing. 2018-05-02 06:34:19,610 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Processed 0 edits across 0 regions; edits skipped=268; log file=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896-splitting/ctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896.1525242635223, length=109612, corrupted=false, progress failed=false 2018-05-02 06:34:19,614 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896-splitting%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%252C16020%252C1525242616896.1525242635223 2018-05-02 06:34:19,614 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coordination.ZkSplitLogWorkerCoordination: successfully transitioned task /hbase-secure/splitWAL/WALs%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%2C16020%2C1525242616896-splitting%2Fctr-e138-1518143905142-279227-01-000008.hwx.site%252C16020%252C1525242616896.1525242635223 to final state DONE ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:19,614 INFO [RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.WALSplitterHandler: Worker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 done with task org.apache.hadoop.hbase.coordination.ZkSplitLogWorkerCoordination$ZkSplitTaskDetails@3e76be1c in 1025ms. Status = DONE 2018-05-02 06:34:19,637 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/splitWAL 2018-05-02 06:34:19,809 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:34:19,811 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:34:19,811 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:19,832 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:34:19,837 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:19,838 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:34:19,840 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:19,840 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:34:19,840 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:34:21,123 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:34:21,272 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:34:21,273 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 59a7b13a4cf2cd2376c378f77087088d, NAME => 'test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d.', STARTKEY => '3d70a3d2', ENDKEY => '47ae1475'} 2018-05-02 06:34:21,274 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AuthenticationService 2018-05-02 06:34:21,275 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=SecureBulkLoadService 2018-05-02 06:34:21,275 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,275 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,275 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,275 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. service=AccessControlService 2018-05-02 06:34:21,275 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,276 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:34:21,276 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:34:21,278 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,302 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:34:21,352 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:34:21,352 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf 2018-05-02 06:34:21,373 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:34:21,374 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:34:21,374 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => 084aa7d8a3bd4d7483494d5a2c39d5df, NAME => 'test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df.', STARTKEY => '7ae147a4', ENDKEY => '851eb847'} 2018-05-02 06:34:21,374 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => dc953453430fbf031584084fad7c31bd, NAME => 'test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 06:34:21,375 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=AuthenticationService 2018-05-02 06:34:21,375 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AuthenticationService 2018-05-02 06:34:21,375 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,375 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,375 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=SecureBulkLoadService 2018-05-02 06:34:21,375 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=SecureBulkLoadService 2018-05-02 06:34:21,375 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,375 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,375 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,375 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,375 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,376 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. service=AccessControlService 2018-05-02 06:34:21,375 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,376 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,376 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,376 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 06:34:21,376 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:34:21,377 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,378 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:34:21,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 60955ebb25dcf0aeb6d46e894a921538, NAME => 'hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:34:21,376 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. service=AccessControlService 2018-05-02 06:34:21,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AuthenticationService 2018-05-02 06:34:21,380 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,380 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,381 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase dc953453430fbf031584084fad7c31bd 2018-05-02 06:34:21,381 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:34:21,381 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,380 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,389 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=SecureBulkLoadService 2018-05-02 06:34:21,389 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,389 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,389 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. service=AccessControlService 2018-05-02 06:34:21,390 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => 5c3fc4872d744c7bdc4c539ee55dc094, NAME => 'test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:34:21,390 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:34:21,391 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AuthenticationService 2018-05-02 06:34:21,391 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,391 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=SecureBulkLoadService 2018-05-02 06:34:21,392 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,392 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table namespace 60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:34:21,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:34:21,392 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,394 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,394 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,395 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. service=AccessControlService 2018-05-02 06:34:21,395 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,395 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,395 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,395 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 06:34:21,395 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:34:21,396 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,396 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,417 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:34:21,418 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => b89f4262e34dfdd1fbea3661f9d50263, NAME => 'hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:34:21,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AuthenticationService 2018-05-02 06:34:21,419 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=SecureBulkLoadService 2018-05-02 06:34:21,419 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,419 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,419 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. service=AccessControlService 2018-05-02 06:34:21,420 WARN [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,420 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table acl b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:34:21,420 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:34:21,422 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:34:21,424 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => 28608f50f9f828e7d3ab571a72b0d5f3, NAME => 'test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3.', STARTKEY => '51eb8518', ENDKEY => '5c28f5bb'} 2018-05-02 06:34:21,425 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=AuthenticationService 2018-05-02 06:34:21,425 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,425 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=SecureBulkLoadService 2018-05-02 06:34:21,425 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,425 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,425 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,425 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. service=AccessControlService 2018-05-02 06:34:21,426 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,426 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,426 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 28608f50f9f828e7d3ab571a72b0d5f3 2018-05-02 06:34:21,426 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:34:21,426 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,455 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 06:34:21,455 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf 2018-05-02 06:34:21,457 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,458 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,463 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf 2018-05-02 06:34:21,463 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf 2018-05-02 06:34:21,464 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,465 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 06:34:21,465 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf 2018-05-02 06:34:21,465 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,467 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,468 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,475 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:34:21,475 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => c963eb77dbdc6dbab886dbe4eebba5ad, NAME => 'test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad.', STARTKEY => '47ae1475', ENDKEY => '51eb8518'} 2018-05-02 06:34:21,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => 8dc6fd2022c2fdf8c065fbd16cadaaca, NAME => 'ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca.', STARTKEY => '', ENDKEY => ''} 2018-05-02 06:34:21,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AuthenticationService 2018-05-02 06:34:21,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AuthenticationService 2018-05-02 06:34:21,476 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=SecureBulkLoadService 2018-05-02 06:34:21,476 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,476 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,476 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => 665f3f34ec072c60acee3dc78af73b62, NAME => 'test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62.', STARTKEY => '8f5c28ea', ENDKEY => '9999998d'} 2018-05-02 06:34:21,476 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:34:21,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AuthenticationService 2018-05-02 06:34:21,477 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,476 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,477 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=SecureBulkLoadService 2018-05-02 06:34:21,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=SecureBulkLoadService 2018-05-02 06:34:21,477 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,477 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,477 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. service=AccessControlService 2018-05-02 06:34:21,478 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:34:21,477 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. service=AccessControlService 2018-05-02 06:34:21,477 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,478 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,479 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,479 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. service=AccessControlService 2018-05-02 06:34:21,479 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,479 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,479 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,480 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table ATLAS_ENTITY_AUDIT_EVENTS 8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 06:34:21,480 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:34:21,480 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => 29fe0b7866912efc70bb3f2d7fd83059, NAME => 'test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059.', STARTKEY => 'e147ae02', ENDKEY => 'eb851ea5'} 2018-05-02 06:34:21,481 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AuthenticationService 2018-05-02 06:34:21,481 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,481 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=SecureBulkLoadService 2018-05-02 06:34:21,481 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,481 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,481 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,482 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. service=AccessControlService 2018-05-02 06:34:21,482 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,482 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,482 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:34:21,482 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:34:21,483 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,485 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,485 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,486 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 06:34:21,486 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:34:21,486 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,479 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,487 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:34:21,487 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:34:21,488 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,489 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:34:21,490 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:34:21,498 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => 931a5308337d39ab8fcac37d3a5e5844, NAME => 'test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 06:34:21,498 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AuthenticationService 2018-05-02 06:34:21,498 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,499 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=SecureBulkLoadService 2018-05-02 06:34:21,499 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,499 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,499 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,499 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. service=AccessControlService 2018-05-02 06:34:21,499 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,499 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,500 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 931a5308337d39ab8fcac37d3a5e5844 2018-05-02 06:34:21,500 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:34:21,500 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,511 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => 1182d8ac9fbcff5334cd5fda2cf0c4a0, NAME => 'test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:34:21,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AuthenticationService 2018-05-02 06:34:21,512 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=SecureBulkLoadService 2018-05-02 06:34:21,512 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,512 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,512 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,512 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. service=AccessControlService 2018-05-02 06:34:21,513 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,513 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,513 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:34:21,513 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:34:21,519 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,521 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:34:21,521 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info 2018-05-02 06:34:21,522 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] hfile.CacheConfig: Created cacheConfig for info: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,522 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:34:21,524 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,541 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf 2018-05-02 06:34:21,541 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf 2018-05-02 06:34:21,548 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:34:21,548 DEBUG [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/l 2018-05-02 06:34:21,556 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:34:21,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => 36261edb1d6e5ae1d91cf96e60680ebc, NAME => 'test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc.', STARTKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF', ENDKEY => ''} 2018-05-02 06:34:21,558 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,559 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] hfile.CacheConfig: Created cacheConfig for l: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,560 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,561 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,558 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. service=AuthenticationService 2018-05-02 06:34:21,563 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,563 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. service=SecureBulkLoadService 2018-05-02 06:34:21,563 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,563 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,563 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,566 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. service=AccessControlService 2018-05-02 06:34:21,570 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,570 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,570 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 36261edb1d6e5ae1d91cf96e60680ebc 2018-05-02 06:34:21,571 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:34:21,571 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,572 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:34:21,573 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opening region: {ENCODED => 1bf9126ca1d7eb9abb934165d5f25857, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857.', STARTKEY => '\x945\xE5\x0DyC^<', ENDKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V'} 2018-05-02 06:34:21,574 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=AuthenticationService 2018-05-02 06:34:21,575 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,575 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=SecureBulkLoadService 2018-05-02 06:34:21,575 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,575 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,575 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,575 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. service=AccessControlService 2018-05-02 06:34:21,576 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,576 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,576 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 1bf9126ca1d7eb9abb934165d5f25857 2018-05-02 06:34:21,576 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:34:21,577 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,579 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => e8edde5a00b30c080b02d1b096794b39, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39.', STARTKEY => '\xC3^P\xD7\x945\xE4\xF2', ENDKEY => '\xCA\x1A\xF2\x86\xBC\xA1\xAF\x0C'} 2018-05-02 06:34:21,579 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=AuthenticationService 2018-05-02 06:34:21,580 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:34:21,582 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=SecureBulkLoadService 2018-05-02 06:34:21,582 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,582 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,582 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,582 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. service=AccessControlService 2018-05-02 06:34:21,583 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,583 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,583 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2018-05-02 06:34:21,585 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:34:21,589 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:34:21,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opening region: {ENCODED => 022c10bc256d7e8dc5d475d7ff8545ea, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:34:21,590 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:34:21,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AuthenticationService 2018-05-02 06:34:21,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opening region: {ENCODED => 0fc1f394ae11e950c87a982abf7c1035, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035.', STARTKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4', ENDKEY => '\xB5\xE5\x0DyC^P\xBE'} 2018-05-02 06:34:21,590 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=SecureBulkLoadService 2018-05-02 06:34:21,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opening region: {ENCODED => a8ff96226d546f0ea151823ae73e5a1b, NAME => 'test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b.', STARTKEY => 'b851eb76', ENDKEY => 'c28f5c19'} 2018-05-02 06:34:21,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=AuthenticationService 2018-05-02 06:34:21,591 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=SecureBulkLoadService 2018-05-02 06:34:21,591 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,591 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,591 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,591 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AuthenticationService 2018-05-02 06:34:21,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. service=AccessControlService 2018-05-02 06:34:21,592 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,592 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=SecureBulkLoadService 2018-05-02 06:34:21,592 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,592 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,592 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,593 INFO [StoreOpener-b89f4262e34dfdd1fbea3661f9d50263-1] regionserver.HStore: Store=l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:21,591 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,594 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,592 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,594 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 0fc1f394ae11e950c87a982abf7c1035 2018-05-02 06:34:21,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:34:21,595 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode e8edde5a00b30c080b02d1b096794b39 2018-05-02 06:34:21,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:34:21,596 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,598 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,599 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. service=AccessControlService 2018-05-02 06:34:21,599 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,599 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,599 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:34:21,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:34:21,600 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] compress.CodecPool: Got brand-new compressor [.gz] 2018-05-02 06:34:21,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. service=AccessControlService 2018-05-02 06:34:21,600 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,600 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:34:21,601 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:34:21,601 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,602 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,603 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,620 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 06:34:21,620 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf 2018-05-02 06:34:21,621 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,622 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,643 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:34:21,643 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf 2018-05-02 06:34:21,645 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,648 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,691 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:34:21,692 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf 2018-05-02 06:34:21,693 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,694 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,710 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:34:21,713 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opening region: {ENCODED => 19c6e3a27177cc57e6cf72ac907048ed, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed.', STARTKEY => '\x9A\xF2\x86\xBC\xA1\xAF(V', ENDKEY => '\xA1\xAF(k\xCA\x1A\xF2p'} 2018-05-02 06:34:21,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=AuthenticationService 2018-05-02 06:34:21,714 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,714 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=SecureBulkLoadService 2018-05-02 06:34:21,714 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,714 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,720 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,720 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. service=AccessControlService 2018-05-02 06:34:21,721 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,724 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,724 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 19c6e3a27177cc57e6cf72ac907048ed 2018-05-02 06:34:21,725 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:34:21,725 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,728 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:34:21,728 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf 2018-05-02 06:34:21,730 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,731 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,756 DEBUG [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/test_cf/9f7cb69b6abe4f57bb56248fe3e04156 2018-05-02 06:34:21,756 INFO [StoreOpener-084aa7d8a3bd4d7483494d5a2c39d5df-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:21,773 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:34:21,773 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 06:34:21,777 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf 2018-05-02 06:34:21,778 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,779 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,780 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opening region: {ENCODED => 89df5caac424c7424fede4183c6dce19, NAME => 'test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19.', STARTKEY => '\xE5\x0DyC^P\xD7t', ENDKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E'} 2018-05-02 06:34:21,781 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=AuthenticationService 2018-05-02 06:34:21,781 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,781 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=SecureBulkLoadService 2018-05-02 06:34:21,781 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,781 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,782 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. service=AccessControlService 2018-05-02 06:34:21,782 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,782 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 89df5caac424c7424fede4183c6dce19 2018-05-02 06:34:21,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:34:21,783 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,784 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:34:21,785 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:34:21,785 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:34:21,785 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:34:21,785 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:34:21,785 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:34:21,785 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:34:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:34:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:34:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:34:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:34:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:34:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:34:21,786 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:34:21,787 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:34:21,787 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:34:21,789 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opening region: {ENCODED => a1d694475a6981010a6489a33c4db464, NAME => 'test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 06:34:21,790 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AuthenticationService 2018-05-02 06:34:21,790 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:21,790 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=SecureBulkLoadService 2018-05-02 06:34:21,790 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:21,790 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:21,790 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:21,790 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. service=AccessControlService 2018-05-02 06:34:21,791 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:21,791 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:21,791 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am a1d694475a6981010a6489a33c4db464 2018-05-02 06:34:21,791 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:34:21,791 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:21,795 DEBUG [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/test_cf/f50a0196e806447fb2330bc9b1168573 2018-05-02 06:34:21,798 INFO [StoreOpener-5c3fc4872d744c7bdc4c539ee55dc094-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:21,800 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:34:21,812 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263 2018-05-02 06:34:21,830 DEBUG [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/f1 2018-05-02 06:34:21,830 DEBUG [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/f1 2018-05-02 06:34:21,834 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1 2018-05-02 06:34:21,834 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1 2018-05-02 06:34:21,836 INFO [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,837 INFO [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,838 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,839 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:34:21,839 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:34:21,839 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:34:21,840 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:34:21,840 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:34:21,840 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:34:21,840 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,840 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:34:21,840 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:34:21,840 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:34:21,858 DEBUG [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/test_cf/51d1fafd7fd44303b7556cecfd380615 2018-05-02 06:34:21,858 INFO [StoreOpener-59a7b13a4cf2cd2376c378f77087088d-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:21,861 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1 2018-05-02 06:34:21,861 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1 2018-05-02 06:34:21,862 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,863 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,884 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:34:21,891 DEBUG [StoreOpener-dc953453430fbf031584084fad7c31bd-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/test_cf/d830ee103d2b41e0ad35903c835935d7 2018-05-02 06:34:21,891 INFO [StoreOpener-dc953453430fbf031584084fad7c31bd-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:21,895 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1 2018-05-02 06:34:21,895 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1 2018-05-02 06:34:21,896 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,898 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,899 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:34:21,901 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:34:21,902 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 06:34:21,903 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt 2018-05-02 06:34:21,904 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] hfile.CacheConfig: Created cacheConfig for dt: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,905 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,907 INFO [StoreOpener-36261edb1d6e5ae1d91cf96e60680ebc-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:21,950 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:34:21,965 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:34:21,965 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf 2018-05-02 06:34:21,966 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,968 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:34:21,968 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1 2018-05-02 06:34:21,973 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:21,973 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,975 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:21,976 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:34:21,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df 2018-05-02 06:34:22,011 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1 2018-05-02 06:34:22,012 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1 2018-05-02 06:34:22,013 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094 2018-05-02 06:34:22,013 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:22,015 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:22,029 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d 2018-05-02 06:34:22,052 DEBUG [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/test_cf/ae5922ae05e649f79a208a0ea340ccb0 2018-05-02 06:34:22,052 DEBUG [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/test_cf/8206d33252364d01b7ddcb8a35cf4b14 2018-05-02 06:34:22,053 INFO [StoreOpener-28608f50f9f828e7d3ab571a72b0d5f3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,053 INFO [StoreOpener-1182d8ac9fbcff5334cd5fda2cf0c4a0-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,061 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1 2018-05-02 06:34:22,061 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1 2018-05-02 06:34:22,062 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:22,062 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:22,103 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd 2018-05-02 06:34:22,105 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:34:22,113 DEBUG [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/info/6d2c6527e61b4d4fa70749387ab7919f 2018-05-02 06:34:22,113 INFO [StoreOpener-60955ebb25dcf0aeb6d46e894a921538-1] regionserver.HStore: Store=info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,125 DEBUG [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/test_cf/8b3b68c170174446a4896b3d11e3b7ac 2018-05-02 06:34:22,125 INFO [StoreOpener-931a5308337d39ab8fcac37d3a5e5844-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,126 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc 2018-05-02 06:34:22,134 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 06:34:22,134 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1 2018-05-02 06:34:22,135 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:22,136 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:22,136 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:34:22,137 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:34:22,137 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:34:22,137 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:34:22,137 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:34:22,137 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:34:22,138 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:34:22,145 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0 2018-05-02 06:34:22,164 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:34:22,164 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:34:22,164 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:34:22,165 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:34:22,172 DEBUG [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/test_cf/868a78f7e95741e79a50cbc01a299926 2018-05-02 06:34:22,172 INFO [StoreOpener-665f3f34ec072c60acee3dc78af73b62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,174 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538 2018-05-02 06:34:22,189 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3 2018-05-02 06:34:22,200 DEBUG [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/test_cf/25e0a99365ef45e2b122cf95cdb0162d 2018-05-02 06:34:22,200 INFO [StoreOpener-29fe0b7866912efc70bb3f2d7fd83059-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,252 INFO [StoreFileOpenerThread-dt-1] compress.CodecPool: Got brand-new decompressor [.gz] 2018-05-02 06:34:22,277 DEBUG [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/f1/bd1273938dfa4fcf838a564a80d2fa5b 2018-05-02 06:34:22,279 DEBUG [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/dt/365f190e72194d82bee2f109d2425208 2018-05-02 06:34:22,286 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:34:22,286 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:34:22,287 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:34:22,287 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:34:22,287 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:34:22,288 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:34:22,288 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:34:22,288 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:34:22,289 INFO [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:34:22,291 DEBUG [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/test_cf/42f1a4762d8e4fd5bd5d8967fe45611c 2018-05-02 06:34:22,298 INFO [StoreOpener-0fc1f394ae11e950c87a982abf7c1035-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,298 INFO [StoreOpener-8dc6fd2022c2fdf8c065fbd16cadaaca-1] regionserver.HStore: Store=dt, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,298 INFO [StoreOpener-c963eb77dbdc6dbab886dbe4eebba5ad-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,308 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844 2018-05-02 06:34:22,324 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62 2018-05-02 06:34:22,326 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=37 2018-05-02 06:34:22,383 DEBUG [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/f1/39f70bcc389446a6a85d27019cee494f 2018-05-02 06:34:22,384 INFO [StoreOpener-1bf9126ca1d7eb9abb934165d5f25857-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,413 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened b89f4262e34dfdd1fbea3661f9d50263; next sequenceid=38 2018-05-02 06:34:22,422 INFO [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Post open deploy tasks for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:34:22,427 DEBUG [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/f1/977dea08c07d4c3986cb36260a1abca4 2018-05-02 06:34:22,428 INFO [StoreOpener-e8edde5a00b30c080b02d1b096794b39-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,430 DEBUG [PostOpenDeployTasks:b89f4262e34dfdd1fbea3661f9d50263] regionserver.HRegionServer: Finished post open deploy task for hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:34:22,430 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:22,434 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059 2018-05-02 06:34:22,518 DEBUG [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/test_cf/0ccbc430bfe6442db21c7e11d482c2f8 2018-05-02 06:34:22,522 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad 2018-05-02 06:34:22,525 INFO [StoreOpener-a8ff96226d546f0ea151823ae73e5a1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:22,526 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/58da7717f6144f42a435d0770d1a1079 2018-05-02 06:34:22,529 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:34:22,533 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca 2018-05-02 06:34:22,833 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/14e594e5be3b4b11ab73ecade93c1f88 2018-05-02 06:34:22,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035 2018-05-02 06:34:22,843 INFO [sync.4] wal.AbstractFSWAL: Slow sync cost: 322 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:34:22,843 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 322 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:34:22,844 INFO [sync.1] wal.AbstractFSWAL: Slow sync cost: 324 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:34:22,845 INFO [sync.2] wal.AbstractFSWAL: Slow sync cost: 324 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:34:22,890 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1/4f8205bfef3349d1b86f968ec0fb4484 2018-05-02 06:34:22,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12446.seqid, newMaxSeqId=12446, maxSeqId=12445 2018-05-02 06:34:22,916 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12611.seqid, newMaxSeqId=12611, maxSeqId=12610 2018-05-02 06:34:22,918 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12203.seqid, newMaxSeqId=12203, maxSeqId=12202 2018-05-02 06:34:22,918 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39 2018-05-02 06:34:23,138 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857 2018-05-02 06:34:23,152 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 59a7b13a4cf2cd2376c378f77087088d; next sequenceid=12446 2018-05-02 06:34:23,157 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 084aa7d8a3bd4d7483494d5a2c39d5df; next sequenceid=12611 2018-05-02 06:34:23,158 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened 5c3fc4872d744c7bdc4c539ee55dc094; next sequenceid=12203 2018-05-02 06:34:23,158 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/recovered.edits/14.seqid, newMaxSeqId=14, maxSeqId=13 2018-05-02 06:34:23,163 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b 2018-05-02 06:34:23,191 DEBUG [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/f1/329e30ab65dc41c3a17097e18564f58b 2018-05-02 06:34:23,199 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened 36261edb1d6e5ae1d91cf96e60680ebc; next sequenceid=14 2018-05-02 06:34:23,208 INFO [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:34:23,214 INFO [StoreOpener-a1d694475a6981010a6489a33c4db464-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:23,216 DEBUG [PostOpenDeployTasks:084aa7d8a3bd4d7483494d5a2c39d5df] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:34:23,216 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,217 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => 1595f38ee901be7c67b997fe2fc95951, NAME => 'test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951.', STARTKEY => '3333332f', ENDKEY => '3d70a3d2'} 2018-05-02 06:34:23,221 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AuthenticationService 2018-05-02 06:34:23,222 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,222 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=SecureBulkLoadService 2018-05-02 06:34:23,222 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,222 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,222 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,222 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. service=AccessControlService 2018-05-02 06:34:23,222 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,222 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,223 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:34:23,223 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:34:23,223 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,245 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13662.seqid, newMaxSeqId=13662, maxSeqId=13661 2018-05-02 06:34:23,245 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/recovered.edits/12699.seqid, newMaxSeqId=12699, maxSeqId=12698 2018-05-02 06:34:23,248 INFO [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:34:23,251 INFO [PostOpenDeployTasks:36261edb1d6e5ae1d91cf96e60680ebc] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:34:23,252 INFO [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:34:23,254 DEBUG [PostOpenDeployTasks:59a7b13a4cf2cd2376c378f77087088d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:34:23,255 DEBUG [PostOpenDeployTasks:36261edb1d6e5ae1d91cf96e60680ebc] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:34:23,255 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,255 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => 6cfc24cc3a423e0969138ce2a69be99e, NAME => 'test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e.', STARTKEY => 'ae147ad3', ENDKEY => 'b851eb76'} 2018-05-02 06:34:23,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,256 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 94f6ca283dbb4445b2bcdc321b734d28, NAME => 'test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28.', STARTKEY => '1eb851e9', ENDKEY => '28f5c28c'} 2018-05-02 06:34:23,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AuthenticationService 2018-05-02 06:34:23,257 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AuthenticationService 2018-05-02 06:34:23,257 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=SecureBulkLoadService 2018-05-02 06:34:23,258 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,258 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,258 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,258 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=SecureBulkLoadService 2018-05-02 06:34:23,258 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,258 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,258 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. service=AccessControlService 2018-05-02 06:34:23,258 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. service=AccessControlService 2018-05-02 06:34:23,259 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,259 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,259 DEBUG [PostOpenDeployTasks:5c3fc4872d744c7bdc4c539ee55dc094] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:34:23,259 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 06:34:23,259 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:34:23,260 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,259 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,260 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 06:34:23,260 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:34:23,261 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,259 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,261 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => bc0d9cf47453518915ae21d2cf637c18, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:34:23,262 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=AuthenticationService 2018-05-02 06:34:23,262 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,262 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=SecureBulkLoadService 2018-05-02 06:34:23,262 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,262 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,262 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,263 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. service=AccessControlService 2018-05-02 06:34:23,264 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,264 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,264 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:34:23,264 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:34:23,264 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,317 DEBUG [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/f1/845389644a5e479097fbc8df18727132 2018-05-02 06:34:23,317 INFO [StoreOpener-022c10bc256d7e8dc5d475d7ff8545ea-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:23,333 DEBUG [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/f1/991129869afa49349c27a04e163824ba 2018-05-02 06:34:23,333 INFO [StoreOpener-89df5caac424c7424fede4183c6dce19-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:23,356 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/13016.seqid, newMaxSeqId=13016, maxSeqId=13015 2018-05-02 06:34:23,385 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened 1182d8ac9fbcff5334cd5fda2cf0c4a0; next sequenceid=13662 2018-05-02 06:34:23,389 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened dc953453430fbf031584084fad7c31bd; next sequenceid=12699 2018-05-02 06:34:23,391 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/46.seqid, newMaxSeqId=46, maxSeqId=45 2018-05-02 06:34:23,410 DEBUG [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/f1/ac824897155b4c70ba4abc8ffd2779e9 2018-05-02 06:34:23,412 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened 665f3f34ec072c60acee3dc78af73b62; next sequenceid=13016 2018-05-02 06:34:23,419 INFO [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:34:23,420 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12468.seqid, newMaxSeqId=12468, maxSeqId=12467 2018-05-02 06:34:23,422 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/recovered.edits/12037.seqid, newMaxSeqId=12037, maxSeqId=12036 2018-05-02 06:34:23,423 INFO [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 60955ebb25dcf0aeb6d46e894a921538; next sequenceid=46 2018-05-02 06:34:23,435 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened 931a5308337d39ab8fcac37d3a5e5844; next sequenceid=12468 2018-05-02 06:34:23,436 INFO [StoreOpener-19c6e3a27177cc57e6cf72ac907048ed-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:23,461 INFO [PostOpenDeployTasks:dc953453430fbf031584084fad7c31bd] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:34:23,462 INFO [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Post open deploy tasks for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:34:23,462 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12256.seqid, newMaxSeqId=12256, maxSeqId=12255 2018-05-02 06:34:23,463 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/78.seqid, newMaxSeqId=78, maxSeqId=77 2018-05-02 06:34:23,464 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12776.seqid, newMaxSeqId=12776, maxSeqId=12775 2018-05-02 06:34:23,467 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19 2018-05-02 06:34:23,469 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened 28608f50f9f828e7d3ab571a72b0d5f3; next sequenceid=12037 2018-05-02 06:34:23,469 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened c963eb77dbdc6dbab886dbe4eebba5ad; next sequenceid=12256 2018-05-02 06:34:23,470 INFO [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:34:23,481 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened 8dc6fd2022c2fdf8c065fbd16cadaaca; next sequenceid=78 2018-05-02 06:34:23,482 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened 29fe0b7866912efc70bb3f2d7fd83059; next sequenceid=12776 2018-05-02 06:34:23,484 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1 2018-05-02 06:34:23,484 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1 2018-05-02 06:34:23,485 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,488 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464 2018-05-02 06:34:23,489 DEBUG [PostOpenDeployTasks:1182d8ac9fbcff5334cd5fda2cf0c4a0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:34:23,489 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,490 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => 2fd8c4d5abf9928da8e8c547a0ca223a, NAME => 'test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:34:23,490 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AuthenticationService 2018-05-02 06:34:23,490 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,490 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=SecureBulkLoadService 2018-05-02 06:34:23,491 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,491 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,491 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,491 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. service=AccessControlService 2018-05-02 06:34:23,491 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,491 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 06:34:23,491 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,491 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf 2018-05-02 06:34:23,491 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 06:34:23,492 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:34:23,492 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,492 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea 2018-05-02 06:34:23,493 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 06:34:23,493 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf 2018-05-02 06:34:23,493 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:34:23,493 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf 2018-05-02 06:34:23,494 DEBUG [PostOpenDeployTasks:dc953453430fbf031584084fad7c31bd] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:34:23,494 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,494 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,494 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,494 DEBUG [PostOpenDeployTasks:665f3f34ec072c60acee3dc78af73b62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:34:23,494 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,494 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,495 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,495 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => 5de3546305c82231844eb840c6cfa983, NAME => 'test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983.', STARTKEY => '\xF9C^P\xD7\x945\xC2', ENDKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF'} 2018-05-02 06:34:23,494 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => ce3059196e012fe2ffadcb5d2b348ce3, NAME => 'test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3.', STARTKEY => '0a3d70a3', ENDKEY => '147ae146'} 2018-05-02 06:34:23,496 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=AuthenticationService 2018-05-02 06:34:23,496 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,496 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=SecureBulkLoadService 2018-05-02 06:34:23,496 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,496 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,496 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,497 INFO [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:34:23,497 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AuthenticationService 2018-05-02 06:34:23,497 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,497 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=SecureBulkLoadService 2018-05-02 06:34:23,497 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,497 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,497 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,497 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. service=AccessControlService 2018-05-02 06:34:23,498 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,498 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,498 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 06:34:23,498 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:34:23,496 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,497 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,498 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,497 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. service=AccessControlService 2018-05-02 06:34:23,499 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,499 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,499 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 5de3546305c82231844eb840c6cfa983 2018-05-02 06:34:23,499 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:34:23,499 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,500 INFO [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:34:23,501 DEBUG [PostOpenDeployTasks:c963eb77dbdc6dbab886dbe4eebba5ad] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:34:23,501 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,501 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => b5180eee96b616afdf79578309c66a11, NAME => 'test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11.', STARTKEY => '6666665e', ENDKEY => '70a3d701'} 2018-05-02 06:34:23,502 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,502 INFO [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Post open deploy tasks for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:34:23,502 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AuthenticationService 2018-05-02 06:34:23,502 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,502 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=SecureBulkLoadService 2018-05-02 06:34:23,502 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,502 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,502 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,502 DEBUG [PostOpenDeployTasks:60955ebb25dcf0aeb6d46e894a921538] regionserver.HRegionServer: Finished post open deploy task for hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:34:23,502 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. service=AccessControlService 2018-05-02 06:34:23,503 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,503 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,503 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode b5180eee96b616afdf79578309c66a11 2018-05-02 06:34:23,503 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:34:23,505 DEBUG [PostOpenDeployTasks:29fe0b7866912efc70bb3f2d7fd83059] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:34:23,505 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,506 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => ffde9f4a59ab08d4830f3b671f736ad5, NAME => 'test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5.', STARTKEY => 'ccccccbc', ENDKEY => 'd70a3d5f'} 2018-05-02 06:34:23,506 DEBUG [PostOpenDeployTasks:8dc6fd2022c2fdf8c065fbd16cadaaca] regionserver.HRegionServer: Finished post open deploy task for ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:34:23,506 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,506 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AuthenticationService 2018-05-02 06:34:23,506 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,506 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => 9f9b6704233f2d2e06a5634fda7f94ca, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca.', STARTKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8', ENDKEY => '\xC3^P\xD7\x945\xE4\xF2'} 2018-05-02 06:34:23,506 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=SecureBulkLoadService 2018-05-02 06:34:23,506 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,506 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,506 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,514 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,514 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. service=AccessControlService 2018-05-02 06:34:23,515 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,515 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,515 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 06:34:23,507 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=AuthenticationService 2018-05-02 06:34:23,515 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,515 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=SecureBulkLoadService 2018-05-02 06:34:23,515 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,515 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,515 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,515 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. service=AccessControlService 2018-05-02 06:34:23,516 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,516 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,516 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 9f9b6704233f2d2e06a5634fda7f94ca 2018-05-02 06:34:23,516 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:34:23,516 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,521 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:34:23,527 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:34:23,528 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,533 INFO [PostOpenDeployTasks:28608f50f9f828e7d3ab571a72b0d5f3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:34:23,534 INFO [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:34:23,541 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed 2018-05-02 06:34:23,542 DEBUG [PostOpenDeployTasks:931a5308337d39ab8fcac37d3a5e5844] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:34:23,542 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,542 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => 51969dda9dfa8895c283f334f944e248, NAME => 'test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248.', STARTKEY => '\xD0\xD7\x945\xE5\x0Dy&', ENDKEY => '\xD7\x945\xE5\x0DyC@'} 2018-05-02 06:34:23,543 DEBUG [PostOpenDeployTasks:28608f50f9f828e7d3ab571a72b0d5f3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:34:23,543 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,548 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => 7b44edd79044515d04eb08298b1e52e9, NAME => 'test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9.', STARTKEY => 'r\x86\xBC\xA1\xAF(k\xBA', ENDKEY => 'yC^P\xD7\x945\xD4'} 2018-05-02 06:34:23,549 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AuthenticationService 2018-05-02 06:34:23,549 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,549 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=SecureBulkLoadService 2018-05-02 06:34:23,550 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AuthenticationService 2018-05-02 06:34:23,551 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,551 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=SecureBulkLoadService 2018-05-02 06:34:23,551 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,551 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,551 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,551 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. service=AccessControlService 2018-05-02 06:34:23,552 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opened 1bf9126ca1d7eb9abb934165d5f25857; next sequenceid=420 2018-05-02 06:34:23,552 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,553 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,549 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,553 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,553 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51969dda9dfa8895c283f334f944e248 2018-05-02 06:34:23,553 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,553 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:34:23,553 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. service=AccessControlService 2018-05-02 06:34:23,553 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,553 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,554 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,554 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:34:23,554 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:34:23,555 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,593 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:34:23,593 INFO [PostOpenDeployTasks:1bf9126ca1d7eb9abb934165d5f25857] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:34:23,594 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11469.seqid, newMaxSeqId=11469, maxSeqId=11468 2018-05-02 06:34:23,598 DEBUG [PostOpenDeployTasks:1bf9126ca1d7eb9abb934165d5f25857] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:34:23,598 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,598 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opening region: {ENCODED => 735f841820ff0baa687bc402b169f4a6, NAME => 'test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6.', STARTKEY => '9999998d', ENDKEY => 'a3d70a30'} 2018-05-02 06:34:23,599 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AuthenticationService 2018-05-02 06:34:23,599 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,599 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=SecureBulkLoadService 2018-05-02 06:34:23,599 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,599 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,599 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,599 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. service=AccessControlService 2018-05-02 06:34:23,600 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,600 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 735f841820ff0baa687bc402b169f4a6 2018-05-02 06:34:23,600 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:34:23,601 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,719 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:34:23,737 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:34:23,738 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened e8edde5a00b30c080b02d1b096794b39; next sequenceid=414 2018-05-02 06:34:23,738 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:34:23,740 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1 2018-05-02 06:34:23,741 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:34:23,741 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,741 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 06:34:23,742 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf 2018-05-02 06:34:23,742 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,743 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:34:23,743 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1 2018-05-02 06:34:23,745 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,746 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,746 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,747 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,747 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1 2018-05-02 06:34:23,747 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1 2018-05-02 06:34:23,748 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,749 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,749 INFO [PostOpenDeployTasks:e8edde5a00b30c080b02d1b096794b39] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:34:23,752 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opened 89df5caac424c7424fede4183c6dce19; next sequenceid=429 2018-05-02 06:34:23,753 DEBUG [PostOpenDeployTasks:e8edde5a00b30c080b02d1b096794b39] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:34:23,755 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,756 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => 9c38689b653a37956f2ae7364b126f1b, NAME => 'test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b.', STARTKEY => 'eb851ea5', ENDKEY => 'f5c28f48'} 2018-05-02 06:34:23,756 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AuthenticationService 2018-05-02 06:34:23,757 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,757 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=SecureBulkLoadService 2018-05-02 06:34:23,757 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,757 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,758 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,758 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. service=AccessControlService 2018-05-02 06:34:23,758 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,759 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,763 INFO [PostOpenDeployTasks:89df5caac424c7424fede4183c6dce19] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:34:23,764 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 06:34:23,764 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf 2018-05-02 06:34:23,765 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,766 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,768 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opened 0fc1f394ae11e950c87a982abf7c1035; next sequenceid=417 2018-05-02 06:34:23,769 DEBUG [PostOpenDeployTasks:89df5caac424c7424fede4183c6dce19] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:34:23,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,769 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opening region: {ENCODED => 3bbeffd33dfc99ea8862c8eae819df62, NAME => 'test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62.', STARTKEY => 'c28f5c19', ENDKEY => 'ccccccbc'} 2018-05-02 06:34:23,770 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AuthenticationService 2018-05-02 06:34:23,770 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,770 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=SecureBulkLoadService 2018-05-02 06:34:23,770 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,770 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,770 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,770 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. service=AccessControlService 2018-05-02 06:34:23,770 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,771 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,771 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_hbase 3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 06:34:23,771 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:34:23,771 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 9c38689b653a37956f2ae7364b126f1b 2018-05-02 06:34:23,771 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:34:23,771 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,772 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,774 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opened a8ff96226d546f0ea151823ae73e5a1b; next sequenceid=11469 2018-05-02 06:34:23,774 INFO [PostOpenDeployTasks:0fc1f394ae11e950c87a982abf7c1035] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:34:23,775 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opened a1d694475a6981010a6489a33c4db464; next sequenceid=426 2018-05-02 06:34:23,784 DEBUG [PostOpenDeployTasks:0fc1f394ae11e950c87a982abf7c1035] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:34:23,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opening region: {ENCODED => 45aba4505046246827a28b03d1c2611e, NAME => 'test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e.', STARTKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4', ENDKEY => '\xB5\xE5\x0DyC^P\xBE'} 2018-05-02 06:34:23,785 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=AuthenticationService 2018-05-02 06:34:23,786 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,786 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=SecureBulkLoadService 2018-05-02 06:34:23,786 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 06:34:23,786 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf 2018-05-02 06:34:23,785 INFO [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:34:23,787 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,787 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,787 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,787 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,789 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,789 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:34:23,789 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf 2018-05-02 06:34:23,791 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. service=AccessControlService 2018-05-02 06:34:23,791 DEBUG [PostOpenDeployTasks:a8ff96226d546f0ea151823ae73e5a1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:34:23,791 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,792 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,792 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,792 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opening region: {ENCODED => 51c9fc854cbebfa25ed419e23bd8ac74, NAME => 'test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74.', STARTKEY => '28f5c28c', ENDKEY => '3333332f'} 2018-05-02 06:34:23,792 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 45aba4505046246827a28b03d1c2611e 2018-05-02 06:34:23,792 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AuthenticationService 2018-05-02 06:34:23,792 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:34:23,792 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=SecureBulkLoadService 2018-05-02 06:34:23,793 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,793 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,793 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. service=AccessControlService 2018-05-02 06:34:23,793 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,793 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,793 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 06:34:23,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:34:23,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,794 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1 2018-05-02 06:34:23,794 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1 2018-05-02 06:34:23,795 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,796 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,800 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,812 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,802 INFO [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:34:23,822 DEBUG [PostOpenDeployTasks:a1d694475a6981010a6489a33c4db464] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:34:23,822 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:23,823 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opening region: {ENCODED => 1d954f21d711345a9587d995cecea136, NAME => 'test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136.', STARTKEY => 'a3d70a30', ENDKEY => 'ae147ad3'} 2018-05-02 06:34:23,823 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AuthenticationService 2018-05-02 06:34:23,823 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:23,823 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=SecureBulkLoadService 2018-05-02 06:34:23,823 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:23,823 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:23,823 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:23,824 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. service=AccessControlService 2018-05-02 06:34:23,824 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:23,824 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:23,824 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 1d954f21d711345a9587d995cecea136 2018-05-02 06:34:23,824 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:34:23,825 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:23,897 DEBUG [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/test_cf/e1e7eacb3d0945eabdc05f9612dcf1a3 2018-05-02 06:34:23,905 INFO [StoreOpener-94f6ca283dbb4445b2bcdc321b734d28-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:23,919 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:34:23,921 DEBUG [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/test_cf/cd508c6396b04928b56ea073a30af8a5 2018-05-02 06:34:23,926 DEBUG [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/f1/738c9260ad314f638f9a79ce7621a39e 2018-05-02 06:34:23,936 INFO [StoreOpener-bc0d9cf47453518915ae21d2cf637c18-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:23,936 INFO [StoreOpener-6cfc24cc3a423e0969138ce2a69be99e-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:23,942 DEBUG [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/test_cf/158884b033494f66a953da36b7d92646 2018-05-02 06:34:23,943 INFO [StoreOpener-1595f38ee901be7c67b997fe2fc95951-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:23,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:23,959 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:34:23,959 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf 2018-05-02 06:34:23,960 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,961 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,970 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opened 19c6e3a27177cc57e6cf72ac907048ed; next sequenceid=420 2018-05-02 06:34:23,974 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opened 022c10bc256d7e8dc5d475d7ff8545ea; next sequenceid=423 2018-05-02 06:34:23,994 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 06:34:23,995 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf 2018-05-02 06:34:23,995 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 06:34:23,995 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf 2018-05-02 06:34:23,996 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,996 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:23,996 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:23,997 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:24,016 INFO [PostOpenDeployTasks:19c6e3a27177cc57e6cf72ac907048ed] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:34:24,017 INFO [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:34:24,027 DEBUG [PostOpenDeployTasks:19c6e3a27177cc57e6cf72ac907048ed] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:34:24,027 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:24,027 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opening region: {ENCODED => 681566c13ee68fa7a27c4bd39d5a79e0, NAME => 'test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0.', STARTKEY => '\xF2\x86\xBC\xA1\xAF(k\xA8', ENDKEY => '\xF9C^P\xD7\x945\xC2'} 2018-05-02 06:34:24,028 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AuthenticationService 2018-05-02 06:34:24,028 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:24,028 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=SecureBulkLoadService 2018-05-02 06:34:24,028 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:24,028 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:24,028 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:24,036 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. service=AccessControlService 2018-05-02 06:34:24,036 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:24,036 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:24,037 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28 2018-05-02 06:34:24,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:34:24,041 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:34:24,042 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:24,044 DEBUG [PostOpenDeployTasks:022c10bc256d7e8dc5d475d7ff8545ea] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:34:24,045 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:24,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opening region: {ENCODED => a58d4c86d2df306cc460a231fd5a1ac1, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1.', STARTKEY => '\xD7\x945\xE5\x0DyC@', ENDKEY => '\xDEP\xD7\x945\xE5\x0DZ'} 2018-05-02 06:34:24,046 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=AuthenticationService 2018-05-02 06:34:24,047 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:24,047 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=SecureBulkLoadService 2018-05-02 06:34:24,047 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:24,047 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:24,047 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:24,047 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. service=AccessControlService 2018-05-02 06:34:24,047 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:24,047 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:24,048 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:34:24,048 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:34:24,048 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:24,053 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1 2018-05-02 06:34:24,053 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1 2018-05-02 06:34:24,054 DEBUG [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/test_cf/99bf1b2ad42a4ca9af12e2d310e96ee0 2018-05-02 06:34:24,054 INFO [StoreOpener-2fd8c4d5abf9928da8e8c547a0ca223a-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,055 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 06:34:24,056 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf 2018-05-02 06:34:24,056 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:24,057 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:24,063 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:24,063 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:24,104 DEBUG [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/test_cf/77acf17fe4d14d729c0a1ecc39e45dbf 2018-05-02 06:34:24,104 INFO [StoreOpener-ce3059196e012fe2ffadcb5d2b348ce3-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,108 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951 2018-05-02 06:34:24,109 DEBUG [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/test_cf/ad05533bf01540c0b9bab2e9f27770e0 2018-05-02 06:34:24,109 INFO [StoreOpener-ffde9f4a59ab08d4830f3b671f736ad5-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,115 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18 2018-05-02 06:34:24,116 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 06:34:24,116 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf 2018-05-02 06:34:24,117 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:24,117 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e 2018-05-02 06:34:24,119 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:24,139 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a 2018-05-02 06:34:24,143 DEBUG [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/f1/0064d3af25e44ea8b522aca7371d86e9 2018-05-02 06:34:24,146 DEBUG [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/f1/3d0f7026a4ef4c89aa664ab8b925b29f 2018-05-02 06:34:24,173 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/62e84ec5a089460ba8f74c367544ffaa 2018-05-02 06:34:24,217 DEBUG [StoreOpener-5de3546305c82231844eb840c6cfa983-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/f1/a22fbfb1317a4c1493bae2cc0fc84cec 2018-05-02 06:34:24,220 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5 2018-05-02 06:34:24,249 INFO [StoreOpener-9f9b6704233f2d2e06a5634fda7f94ca-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,249 INFO [StoreOpener-7b44edd79044515d04eb08298b1e52e9-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,290 INFO [StoreOpener-5de3546305c82231844eb840c6cfa983-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,567 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3 2018-05-02 06:34:24,577 DEBUG [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/test_cf/701b265951a9459fbb2a9068086da9e9 2018-05-02 06:34:24,577 INFO [StoreOpener-735f841820ff0baa687bc402b169f4a6-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,625 DEBUG [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/test_cf/7a69b14b3a874236a929721884c99143 2018-05-02 06:34:24,625 INFO [StoreOpener-b5180eee96b616afdf79578309c66a11-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,643 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 06:34:24,643 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1 2018-05-02 06:34:24,644 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1 2018-05-02 06:34:24,644 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1 2018-05-02 06:34:24,646 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13420.seqid, newMaxSeqId=13420, maxSeqId=13419 2018-05-02 06:34:24,649 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:24,649 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:24,654 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:24,655 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:24,656 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983 2018-05-02 06:34:24,679 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9 2018-05-02 06:34:24,680 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca 2018-05-02 06:34:24,680 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 94f6ca283dbb4445b2bcdc321b734d28; next sequenceid=13420 2018-05-02 06:34:24,689 INFO [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:34:24,689 DEBUG [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/f1/7710e9b7b85f4d579e501a6dce5fd537 2018-05-02 06:34:24,689 INFO [StoreOpener-51969dda9dfa8895c283f334f944e248-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,694 DEBUG [PostOpenDeployTasks:94f6ca283dbb4445b2bcdc321b734d28] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:34:24,694 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:24,695 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 70ed82a86a0f0c62d692e8ffd1c0f904, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904.', STARTKEY => '\xF9C^P\xD7\x945\xC2', ENDKEY => '\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF'} 2018-05-02 06:34:24,695 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=AuthenticationService 2018-05-02 06:34:24,695 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:24,696 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=SecureBulkLoadService 2018-05-02 06:34:24,696 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:24,696 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:24,696 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:24,696 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. service=AccessControlService 2018-05-02 06:34:24,696 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:24,696 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:24,696 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:34:24,697 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:34:24,697 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:24,724 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6 2018-05-02 06:34:24,742 DEBUG [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/test_cf/081e4f87bb6141d5bac9d82300027aa3 2018-05-02 06:34:24,743 INFO [StoreOpener-3bbeffd33dfc99ea8862c8eae819df62-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,744 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11 2018-05-02 06:34:24,769 DEBUG [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/test_cf/5e3da6c9f6924f878ff6491016ba25bf 2018-05-02 06:34:24,769 INFO [StoreOpener-1d954f21d711345a9587d995cecea136-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,778 DEBUG [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/test_cf/e5a8c5ffbf754c8796432534239a0e81 2018-05-02 06:34:24,778 INFO [StoreOpener-9c38689b653a37956f2ae7364b126f1b-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12333.seqid, newMaxSeqId=12333, maxSeqId=12332 2018-05-02 06:34:24,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11483.seqid, newMaxSeqId=11483, maxSeqId=11482 2018-05-02 06:34:24,804 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1/9183f33444af4ba4b0488cd21989a0e1 2018-05-02 06:34:24,805 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:34:24,807 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248 2018-05-02 06:34:24,813 DEBUG [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/test_cf/e84e460a6b1849daa9fe3dd7067bbe01 2018-05-02 06:34:24,814 INFO [StoreOpener-51c9fc854cbebfa25ed419e23bd8ac74-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:24,824 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 1595f38ee901be7c67b997fe2fc95951; next sequenceid=11483 2018-05-02 06:34:24,824 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/12257.seqid, newMaxSeqId=12257, maxSeqId=12256 2018-05-02 06:34:24,825 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened 2fd8c4d5abf9928da8e8c547a0ca223a; next sequenceid=12333 2018-05-02 06:34:24,832 INFO [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:34:24,836 INFO [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:34:24,836 DEBUG [PostOpenDeployTasks:2fd8c4d5abf9928da8e8c547a0ca223a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:34:24,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:24,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => 299c3061e2a10cee5be3bff86a2ec41a, NAME => 'test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a.', STARTKEY => '\xB5\xE5\x0DyC^P\xBE', ENDKEY => '\xBC\xA1\xAF(k\xCA\x1A\xD8'} 2018-05-02 06:34:24,838 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=AuthenticationService 2018-05-02 06:34:24,839 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:24,839 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=SecureBulkLoadService 2018-05-02 06:34:24,839 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:24,839 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:24,840 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:24,840 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. service=AccessControlService 2018-05-02 06:34:24,840 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:24,840 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:24,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 299c3061e2a10cee5be3bff86a2ec41a 2018-05-02 06:34:24,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:34:24,841 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:24,843 DEBUG [PostOpenDeployTasks:1595f38ee901be7c67b997fe2fc95951] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:34:24,843 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:24,843 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => 3f499471b0415a38ad5efe046913cba2, NAME => 'test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2.', STARTKEY => '\xDEP\xD7\x945\xE5\x0DZ', ENDKEY => '\xE5\x0DyC^P\xD7t'} 2018-05-02 06:34:24,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AuthenticationService 2018-05-02 06:34:24,844 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:24,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=SecureBulkLoadService 2018-05-02 06:34:24,844 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:24,844 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:24,844 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:24,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. service=AccessControlService 2018-05-02 06:34:24,845 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:24,845 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:24,845 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3f499471b0415a38ad5efe046913cba2 2018-05-02 06:34:24,845 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:34:24,846 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:24,869 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened bc0d9cf47453518915ae21d2cf637c18; next sequenceid=420 2018-05-02 06:34:24,873 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:34:24,873 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:34:24,876 INFO [PostOpenDeployTasks:bc0d9cf47453518915ae21d2cf637c18] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:34:24,877 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62 2018-05-02 06:34:24,882 DEBUG [PostOpenDeployTasks:bc0d9cf47453518915ae21d2cf637c18] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:34:24,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:24,882 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened 6cfc24cc3a423e0969138ce2a69be99e; next sequenceid=12257 2018-05-02 06:34:24,882 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => b8144dc37f351e256653e1454207538f, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f.', STARTKEY => '\xE5\x0DyC^P\xD7t', ENDKEY => '\xEB\xCA\x1A\xF2\x86\xBC\xA1\x8E'} 2018-05-02 06:34:24,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=AuthenticationService 2018-05-02 06:34:24,891 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:24,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=SecureBulkLoadService 2018-05-02 06:34:24,891 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:24,891 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:24,891 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:24,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. service=AccessControlService 2018-05-02 06:34:24,892 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:24,892 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:24,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode b8144dc37f351e256653e1454207538f 2018-05-02 06:34:24,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:34:24,893 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:24,905 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b 2018-05-02 06:34:24,908 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136 2018-05-02 06:34:24,909 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1 2018-05-02 06:34:24,909 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1 2018-05-02 06:34:24,910 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:24,911 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:24,925 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12822.seqid, newMaxSeqId=12822, maxSeqId=12821 2018-05-02 06:34:24,928 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/12005.seqid, newMaxSeqId=12005, maxSeqId=12004 2018-05-02 06:34:24,932 INFO [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:34:24,943 DEBUG [PostOpenDeployTasks:6cfc24cc3a423e0969138ce2a69be99e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:34:24,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:24,944 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => 25414d6e395eadb383c40973693beb12, NAME => 'test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12.', STARTKEY => '\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE', ENDKEY => '\x86\xBC\xA1\xAF(k\xCA\x08'} 2018-05-02 06:34:24,945 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=AuthenticationService 2018-05-02 06:34:24,945 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:24,945 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=SecureBulkLoadService 2018-05-02 06:34:24,945 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:24,945 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:24,945 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:24,945 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. service=AccessControlService 2018-05-02 06:34:24,946 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:24,946 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:24,946 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 25414d6e395eadb383c40973693beb12 2018-05-02 06:34:24,946 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:34:24,946 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:24,955 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74 2018-05-02 06:34:24,957 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened ffde9f4a59ab08d4830f3b671f736ad5; next sequenceid=12005 2018-05-02 06:34:24,972 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened ce3059196e012fe2ffadcb5d2b348ce3; next sequenceid=12822 2018-05-02 06:34:24,976 INFO [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:34:24,988 DEBUG [PostOpenDeployTasks:ffde9f4a59ab08d4830f3b671f736ad5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:34:24,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:24,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => bcf3e62f0ae8e672bee1318720d62930, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930.', STARTKEY => '\xA8k\xCA\x1A\xF2\x86\xBC\x8A', ENDKEY => '\xAF(k\xCA\x1A\xF2\x86\xA4'} 2018-05-02 06:34:24,993 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=AuthenticationService 2018-05-02 06:34:24,994 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:24,994 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=SecureBulkLoadService 2018-05-02 06:34:24,994 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:24,999 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:24,995 INFO [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:34:24,999 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:24,999 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. service=AccessControlService 2018-05-02 06:34:24,999 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:24,999 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:25,000 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bcf3e62f0ae8e672bee1318720d62930 2018-05-02 06:34:25,000 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:34:25,000 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:24,999 DEBUG [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/f1/3717a65158e54236b948e9f7a20e1344 2018-05-02 06:34:25,008 DEBUG [PostOpenDeployTasks:ce3059196e012fe2ffadcb5d2b348ce3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:34:25,009 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:25,009 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opening region: {ENCODED => 93aea36f9251cfe49e28f84a517e3630, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:34:25,010 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AuthenticationService 2018-05-02 06:34:25,010 DEBUG [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/f1/9ca70b0c41a14a7db0a7b4b70bd83580 2018-05-02 06:34:25,010 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:25,013 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=SecureBulkLoadService 2018-05-02 06:34:25,013 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:25,013 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:25,013 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:25,013 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. service=AccessControlService 2018-05-02 06:34:25,014 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:25,015 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:25,015 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:34:25,016 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:34:25,017 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:25,032 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:25,038 INFO [StoreOpener-45aba4505046246827a28b03d1c2611e-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:25,040 INFO [StoreOpener-681566c13ee68fa7a27c4bd39d5a79e0-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:25,092 DEBUG [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/f1/01f9f6a5501f41208ca4e0b19e9e7c04 2018-05-02 06:34:25,093 INFO [StoreOpener-a58d4c86d2df306cc460a231fd5a1ac1-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:25,330 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:34:25,330 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:34:25,330 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:34:25,392 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:34:25,401 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:34:25,401 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:34:25,446 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1 2018-05-02 06:34:25,446 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1 2018-05-02 06:34:25,448 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:25,449 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:25,801 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:34:25,816 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:34:25,816 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:34:25,818 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:34:25,818 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:34:25,818 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:34:25,818 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:34:25,818 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:34:25,827 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened 9f9b6704233f2d2e06a5634fda7f94ca; next sequenceid=423 2018-05-02 06:34:25,829 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12172.seqid, newMaxSeqId=12172, maxSeqId=12171 2018-05-02 06:34:25,832 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1 2018-05-02 06:34:25,833 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1 2018-05-02 06:34:25,834 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:25,834 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:25,835 INFO [PostOpenDeployTasks:9f9b6704233f2d2e06a5634fda7f94ca] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:34:25,840 DEBUG [PostOpenDeployTasks:9f9b6704233f2d2e06a5634fda7f94ca] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:34:25,840 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:25,841 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opening region: {ENCODED => 5fc7cfd582bc270c530fe9787011078c, NAME => 'test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c.', STARTKEY => '!\xAF(k\xCA\x1A\xF2\x82', ENDKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C'} 2018-05-02 06:34:25,842 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=AuthenticationService 2018-05-02 06:34:25,842 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:25,842 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=SecureBulkLoadService 2018-05-02 06:34:25,842 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:25,842 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:25,843 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:25,843 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. service=AccessControlService 2018-05-02 06:34:25,843 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:25,843 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:25,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 5fc7cfd582bc270c530fe9787011078c 2018-05-02 06:34:25,844 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:34:25,854 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:25,856 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:25,858 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:34:25,858 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1 2018-05-02 06:34:25,861 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12249.seqid, newMaxSeqId=12249, maxSeqId=12248 2018-05-02 06:34:25,862 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:25,864 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:25,876 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened b5180eee96b616afdf79578309c66a11; next sequenceid=12172 2018-05-02 06:34:25,883 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:34:25,884 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0 2018-05-02 06:34:25,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e 2018-05-02 06:34:25,891 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1 2018-05-02 06:34:25,891 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1 2018-05-02 06:34:25,903 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:25,904 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:25,904 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened 5de3546305c82231844eb840c6cfa983; next sequenceid=423 2018-05-02 06:34:25,924 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1 2018-05-02 06:34:25,924 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1 2018-05-02 06:34:25,925 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:25,925 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:25,932 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opened 735f841820ff0baa687bc402b169f4a6; next sequenceid=12249 2018-05-02 06:34:25,950 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1 2018-05-02 06:34:25,951 INFO [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:34:25,951 INFO [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:34:25,951 INFO [PostOpenDeployTasks:5de3546305c82231844eb840c6cfa983] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:34:25,955 DEBUG [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/f1/8d2cf3534de147ed904b9fc82a8f2b3b 2018-05-02 06:34:25,961 INFO [StoreOpener-70ed82a86a0f0c62d692e8ffd1c0f904-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:25,963 DEBUG [PostOpenDeployTasks:5de3546305c82231844eb840c6cfa983] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:34:25,963 DEBUG [PostOpenDeployTasks:b5180eee96b616afdf79578309c66a11] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:34:25,962 DEBUG [PostOpenDeployTasks:735f841820ff0baa687bc402b169f4a6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:34:25,978 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:25,981 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:25,981 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:25,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opening region: {ENCODED => 166b9a4d8133a32343e23907c3228d62, NAME => 'test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62.', STARTKEY => '<\xA1\xAF(k\xCA\x1A\xEA', ENDKEY => 'C^P\xD7\x945\xE5\x04'} 2018-05-02 06:34:25,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=AuthenticationService 2018-05-02 06:34:25,992 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:25,992 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=SecureBulkLoadService 2018-05-02 06:34:25,992 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:25,992 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:25,992 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:25,993 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. service=AccessControlService 2018-05-02 06:34:25,993 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:25,993 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:25,993 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 166b9a4d8133a32343e23907c3228d62 2018-05-02 06:34:25,993 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:34:25,994 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:25,994 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened 7b44edd79044515d04eb08298b1e52e9; next sequenceid=429 2018-05-02 06:34:25,995 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opening region: {ENCODED => 47c574242e461d8e7a12972718bc27ff, NAME => 'test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:34:25,995 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AuthenticationService 2018-05-02 06:34:25,995 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:25,995 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=SecureBulkLoadService 2018-05-02 06:34:25,995 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:25,995 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:25,995 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:25,995 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. service=AccessControlService 2018-05-02 06:34:25,995 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:34:25,995 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1 2018-05-02 06:34:25,996 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:25,996 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:25,996 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 47c574242e461d8e7a12972718bc27ff 2018-05-02 06:34:25,996 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:34:25,996 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:25,991 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opening region: {ENCODED => 6e9424b67ac115dc3547de9b3eb4c5ef, NAME => 'test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef.', STARTKEY => '^P\xD7\x945\xE5\x0Dl', ENDKEY => 'e\x0DyC^P\xD7\x86'} 2018-05-02 06:34:25,996 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:25,997 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=AuthenticationService 2018-05-02 06:34:25,997 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:25,997 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=SecureBulkLoadService 2018-05-02 06:34:25,997 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:25,997 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:25,997 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:25,997 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:25,997 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. service=AccessControlService 2018-05-02 06:34:25,998 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:25,998 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:25,998 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 6e9424b67ac115dc3547de9b3eb4c5ef 2018-05-02 06:34:25,998 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:34:25,999 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:26,015 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:34:26,043 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12774.seqid, newMaxSeqId=12774, maxSeqId=12773 2018-05-02 06:34:26,044 INFO [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:34:26,062 DEBUG [PostOpenDeployTasks:7b44edd79044515d04eb08298b1e52e9] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:34:26,062 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:26,063 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => 98abf1ead3bf61c95cc4ffe5e6e5fe96, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:34:26,063 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AuthenticationService 2018-05-02 06:34:26,063 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:26,063 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=SecureBulkLoadService 2018-05-02 06:34:26,063 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:26,063 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:26,064 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:26,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. service=AccessControlService 2018-05-02 06:34:26,064 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:26,064 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:26,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:34:26,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:34:26,065 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:26,147 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened 9c38689b653a37956f2ae7364b126f1b; next sequenceid=12774 2018-05-02 06:34:26,153 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12477.seqid, newMaxSeqId=12477, maxSeqId=12476 2018-05-02 06:34:26,154 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1 2018-05-02 06:34:26,154 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1 2018-05-02 06:34:26,155 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:26,156 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened 51969dda9dfa8895c283f334f944e248; next sequenceid=426 2018-05-02 06:34:26,156 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904 2018-05-02 06:34:26,163 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:26,176 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opened 3bbeffd33dfc99ea8862c8eae819df62; next sequenceid=12477 2018-05-02 06:34:26,187 INFO [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:34:26,188 INFO [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:34:26,190 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12560.seqid, newMaxSeqId=12560, maxSeqId=12559 2018-05-02 06:34:26,192 DEBUG [PostOpenDeployTasks:9c38689b653a37956f2ae7364b126f1b] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:34:26,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:26,192 DEBUG [PostOpenDeployTasks:51969dda9dfa8895c283f334f944e248] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:34:26,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:26,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => 3ea52812fafc49b1651e26e1bd43ec97, NAME => 'test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97.', STARTKEY => 'W\x945\xE5\x0DyCR', ENDKEY => '^P\xD7\x945\xE5\x0Dl'} 2018-05-02 06:34:26,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opening region: {ENCODED => bb19a5bd59b1b3dff86020949234aaf5, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5.', STARTKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E', ENDKEY => 'P\xD7\x945\xE5\x0Dy8'} 2018-05-02 06:34:26,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=AuthenticationService 2018-05-02 06:34:26,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=AuthenticationService 2018-05-02 06:34:26,193 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:26,194 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=SecureBulkLoadService 2018-05-02 06:34:26,194 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:26,194 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:26,194 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:26,194 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. service=AccessControlService 2018-05-02 06:34:26,194 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:26,194 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:26,194 INFO [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:34:26,193 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:26,195 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=SecureBulkLoadService 2018-05-02 06:34:26,195 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:26,195 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:26,195 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:26,194 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:34:26,195 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:34:26,196 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:26,196 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. service=AccessControlService 2018-05-02 06:34:26,197 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:26,197 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:26,197 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 3ea52812fafc49b1651e26e1bd43ec97 2018-05-02 06:34:26,199 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:34:26,200 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:26,208 DEBUG [PostOpenDeployTasks:3bbeffd33dfc99ea8862c8eae819df62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:34:26,208 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opened 1d954f21d711345a9587d995cecea136; next sequenceid=12560 2018-05-02 06:34:26,208 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:26,209 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opening region: {ENCODED => 7386aea828f5bbf6f2bb9358162092e6, NAME => 'test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6.', STARTKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h', ENDKEY => '!\xAF(k\xCA\x1A\xF2\x82'} 2018-05-02 06:34:26,209 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AuthenticationService 2018-05-02 06:34:26,209 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:26,210 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=SecureBulkLoadService 2018-05-02 06:34:26,210 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:26,210 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:26,210 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:26,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. service=AccessControlService 2018-05-02 06:34:26,213 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:26,213 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:26,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7386aea828f5bbf6f2bb9358162092e6 2018-05-02 06:34:26,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:34:26,214 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:26,228 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12312.seqid, newMaxSeqId=12312, maxSeqId=12311 2018-05-02 06:34:26,231 INFO [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:34:26,235 DEBUG [PostOpenDeployTasks:1d954f21d711345a9587d995cecea136] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:34:26,236 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:26,236 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opening region: {ENCODED => 93a15c4ca6299bea02a86ac40494d75a, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x00\x00\x00\x00\x00'} 2018-05-02 06:34:26,237 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=AuthenticationService 2018-05-02 06:34:26,237 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:26,237 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=SecureBulkLoadService 2018-05-02 06:34:26,237 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:26,237 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:26,237 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:26,237 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. service=AccessControlService 2018-05-02 06:34:26,237 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:26,238 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:26,249 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 93a15c4ca6299bea02a86ac40494d75a 2018-05-02 06:34:26,249 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:34:26,249 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:26,774 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@799d1f7a 2018-05-02 06:34:26,776 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:34:26,778 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:34:26,778 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 06:34:26,782 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d93900c8, negotiated timeout = 10000 2018-05-02 06:34:26,783 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:34:26,793 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:34:26,796 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:34:27,116 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opened 51c9fc854cbebfa25ed419e23bd8ac74; next sequenceid=12312 2018-05-02 06:34:27,124 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 06:34:27,125 INFO [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:34:27,129 DEBUG [PostOpenDeployTasks:51c9fc854cbebfa25ed419e23bd8ac74] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:34:27,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opening region: {ENCODED => 46af8f9145c39f07531ceaa92c7f8dbc, NAME => 'test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc.', STARTKEY => 'C^P\xD7\x945\xE5\x04', ENDKEY => 'J\x1A\xF2\x86\xBC\xA1\xAF\x1E'} 2018-05-02 06:34:27,132 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=AuthenticationService 2018-05-02 06:34:27,133 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,133 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=SecureBulkLoadService 2018-05-02 06:34:27,133 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,133 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,133 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,133 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. service=AccessControlService 2018-05-02 06:34:27,133 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,133 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,133 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 46af8f9145c39f07531ceaa92c7f8dbc 2018-05-02 06:34:27,133 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:34:27,134 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,141 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:34:27,141 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1 2018-05-02 06:34:27,141 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,142 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,147 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1 2018-05-02 06:34:27,147 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1 2018-05-02 06:34:27,148 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,148 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:34:27,149 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1 2018-05-02 06:34:27,149 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,150 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1 2018-05-02 06:34:27,150 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1 2018-05-02 06:34:27,150 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,150 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,151 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1/1ea04ea101ef4b97b972fcf1e2c389dc 2018-05-02 06:34:27,154 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:27,162 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,163 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,166 DEBUG [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/f1/abc0da0f84f64790a2c93880ca66ac5e 2018-05-02 06:34:27,166 INFO [StoreOpener-3f499471b0415a38ad5efe046913cba2-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,167 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:34:27,176 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opened 681566c13ee68fa7a27c4bd39d5a79e0; next sequenceid=423 2018-05-02 06:34:27,179 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1/2634850b34ea44e88f4b0d654c593d82 2018-05-02 06:34:27,179 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1/bc3bcfcc061c4f8983a05c3b21b4aba4 2018-05-02 06:34:27,182 DEBUG [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/f1/a3522ed3bfda433db7a713973ceaf88b 2018-05-02 06:34:27,184 INFO [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:34:27,185 INFO [StoreOpener-bcf3e62f0ae8e672bee1318720d62930-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,186 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:27,188 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 06:34:27,189 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1 2018-05-02 06:34:27,189 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opened 45aba4505046246827a28b03d1c2611e; next sequenceid=426 2018-05-02 06:34:27,189 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,190 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,191 DEBUG [PostOpenDeployTasks:681566c13ee68fa7a27c4bd39d5a79e0] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:34:27,191 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,191 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opening region: {ENCODED => 1fa0746104343e63d4a6c982f8a3bf32, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32.', STARTKEY => '!\xAF(k\xCA\x1A\xF2\x82', ENDKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C'} 2018-05-02 06:34:27,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=AuthenticationService 2018-05-02 06:34:27,192 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=SecureBulkLoadService 2018-05-02 06:34:27,192 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,192 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,192 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,192 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. service=AccessControlService 2018-05-02 06:34:27,192 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opened a58d4c86d2df306cc460a231fd5a1ac1; next sequenceid=423 2018-05-02 06:34:27,192 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,192 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 1fa0746104343e63d4a6c982f8a3bf32 2018-05-02 06:34:27,193 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:34:27,193 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,194 DEBUG [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/f1 2018-05-02 06:34:27,194 DEBUG [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/f1 2018-05-02 06:34:27,195 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,196 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,197 INFO [PostOpenDeployTasks:45aba4505046246827a28b03d1c2611e] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:34:27,200 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 06:34:27,200 DEBUG [PostOpenDeployTasks:45aba4505046246827a28b03d1c2611e] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:34:27,200 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,203 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1 2018-05-02 06:34:27,203 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1 2018-05-02 06:34:27,203 INFO [PostOpenDeployTasks:a58d4c86d2df306cc460a231fd5a1ac1] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:34:27,204 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,207 DEBUG [PostOpenDeployTasks:a58d4c86d2df306cc460a231fd5a1ac1] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:34:27,207 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opening region: {ENCODED => 530aabaf92e988eadd5338ed38b9be0c, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c.', STARTKEY => '\x00\x00\x00\x00\x00\x00\x00\x00', ENDKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A'} 2018-05-02 06:34:27,207 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=AuthenticationService 2018-05-02 06:34:27,207 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,208 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=SecureBulkLoadService 2018-05-02 06:34:27,208 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,208 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,208 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,208 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. service=AccessControlService 2018-05-02 06:34:27,208 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,208 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,208 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 530aabaf92e988eadd5338ed38b9be0c 2018-05-02 06:34:27,209 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:34:27,209 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,211 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,213 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,214 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opening region: {ENCODED => 685781049fdcc89efe3561b69e4d3810, NAME => 'test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810.', STARTKEY => 'P\xD7\x945\xE5\x0Dy8', ENDKEY => 'W\x945\xE5\x0DyCR'} 2018-05-02 06:34:27,214 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AuthenticationService 2018-05-02 06:34:27,214 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,214 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=SecureBulkLoadService 2018-05-02 06:34:27,214 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,214 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,214 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,215 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. service=AccessControlService 2018-05-02 06:34:27,215 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,215 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,215 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 685781049fdcc89efe3561b69e4d3810 2018-05-02 06:34:27,216 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:34:27,216 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,218 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1 2018-05-02 06:34:27,219 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1 2018-05-02 06:34:27,219 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,221 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,223 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1 2018-05-02 06:34:27,223 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1 2018-05-02 06:34:27,228 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2 2018-05-02 06:34:27,244 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 06:34:27,244 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1 2018-05-02 06:34:27,245 INFO [StoreOpener-93a15c4ca6299bea02a86ac40494d75a-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,247 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/335c9d0ca00f43be9b2be1bdaf09a958 2018-05-02 06:34:27,245 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,249 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,250 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/recovered.edits/414.seqid, newMaxSeqId=414, maxSeqId=413 2018-05-02 06:34:27,250 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,251 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,284 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1 2018-05-02 06:34:27,284 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1 2018-05-02 06:34:27,284 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1 2018-05-02 06:34:27,285 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,286 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,287 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1 2018-05-02 06:34:27,287 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,288 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,300 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 70ed82a86a0f0c62d692e8ffd1c0f904; next sequenceid=414 2018-05-02 06:34:27,313 INFO [PostOpenDeployTasks:70ed82a86a0f0c62d692e8ffd1c0f904] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:34:27,317 DEBUG [PostOpenDeployTasks:70ed82a86a0f0c62d692e8ffd1c0f904] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:34:27,317 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,318 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => 8c7dd0ad2a67fa6a32d1f3694eef56eb, NAME => 'test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb.', STARTKEY => '', ENDKEY => '0a3d70a3'} 2018-05-02 06:34:27,318 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AuthenticationService 2018-05-02 06:34:27,318 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,318 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=SecureBulkLoadService 2018-05-02 06:34:27,319 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,319 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,319 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. service=AccessControlService 2018-05-02 06:34:27,319 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,319 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_load_test_tool_namenode 8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:34:27,319 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:34:27,334 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930 2018-05-02 06:34:27,334 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1/94cb8f2a93da4c488fdc446518fd1cc5 2018-05-02 06:34:27,334 DEBUG [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/f1/c2e9664311c1425886ec633633fdcd6b 2018-05-02 06:34:27,334 INFO [StoreOpener-299c3061e2a10cee5be3bff86a2ec41a-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,351 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a 2018-05-02 06:34:27,352 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,354 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1/6cba47e832104f3da47cbb23a9bc05f2 2018-05-02 06:34:27,373 DEBUG [StoreOpener-b8144dc37f351e256653e1454207538f-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/f1/b9fd06c3a1d143b3955e7818940543a8 2018-05-02 06:34:27,373 DEBUG [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/f1/d841feb0096c401b9a78e0050ee83d68 2018-05-02 06:34:27,373 INFO [StoreOpener-b8144dc37f351e256653e1454207538f-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,373 INFO [StoreOpener-25414d6e395eadb383c40973693beb12-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,385 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:34:27,412 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12 2018-05-02 06:34:27,412 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/210fc8ab70c74f0b94dd06fb92efaddb 2018-05-02 06:34:27,444 DEBUG [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/f1/295233e1f4a34156ae67883afcf73774 2018-05-02 06:34:27,444 INFO [StoreOpener-bb19a5bd59b1b3dff86020949234aaf5-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,448 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:34:27,448 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf 2018-05-02 06:34:27,449 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] hfile.CacheConfig: Created cacheConfig for test_cf: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,449 DEBUG [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/f1/90df418002ae42479d76f78c99ff2a2a 2018-05-02 06:34:27,450 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,454 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/60b42671ed6b409aaa6359fb0d738bd1 2018-05-02 06:34:27,456 INFO [StoreOpener-98abf1ead3bf61c95cc4ffe5e6e5fe96-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,472 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:34:27,474 DEBUG [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/f1/8cbf0c74e0754545a377c74c6bcdb70f 2018-05-02 06:34:27,474 INFO [StoreOpener-93aea36f9251cfe49e28f84a517e3630-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,478 DEBUG [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/f1/2c27a1bafac241928300cca4169c9f94 2018-05-02 06:34:27,480 INFO [StoreOpener-3ea52812fafc49b1651e26e1bd43ec97-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,482 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/246ab8cb4abd4f17b71986dd12fa3c37 2018-05-02 06:34:27,489 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f 2018-05-02 06:34:27,510 DEBUG [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/f1/abd14eb0366d49d6b1f9c4e3beb7ea22 2018-05-02 06:34:27,510 INFO [StoreOpener-166b9a4d8133a32343e23907c3228d62-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,565 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=16 2018-05-02 06:34:27,569 DEBUG [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/f1/76ab8edd7657482f8dbe68fd37422b11 2018-05-02 06:34:27,569 INFO [StoreOpener-46af8f9145c39f07531ceaa92c7f8dbc-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,595 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a 2018-05-02 06:34:27,599 DEBUG [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/f1/dbd2816429b24832a77a1b06377230f4 2018-05-02 06:34:27,599 INFO [StoreOpener-5fc7cfd582bc270c530fe9787011078c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,601 DEBUG [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/f1/75a153d8f4a240b1ac387295522fdac6 2018-05-02 06:34:27,601 INFO [StoreOpener-6e9424b67ac115dc3547de9b3eb4c5ef-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,601 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened 3f499471b0415a38ad5efe046913cba2; next sequenceid=429 2018-05-02 06:34:27,602 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5 2018-05-02 06:34:27,604 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opened 93a15c4ca6299bea02a86ac40494d75a; next sequenceid=17 2018-05-02 06:34:27,605 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96 2018-05-02 06:34:27,612 INFO [PostOpenDeployTasks:93a15c4ca6299bea02a86ac40494d75a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:34:27,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97 2018-05-02 06:34:27,614 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62 2018-05-02 06:34:27,620 DEBUG [PostOpenDeployTasks:93a15c4ca6299bea02a86ac40494d75a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:34:27,620 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,620 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opening region: {ENCODED => 51119cebc42546d1c9f2590eec5a49b3, NAME => 'test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3.', STARTKEY => '\x00\x00\x00\x00\x00\x00\x00\x00', ENDKEY => '\x06\xBC\xA1\xAF(k\xCA\x1A'} 2018-05-02 06:34:27,620 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=AuthenticationService 2018-05-02 06:34:27,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,621 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=SecureBulkLoadService 2018-05-02 06:34:27,621 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,621 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,621 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. service=AccessControlService 2018-05-02 06:34:27,621 DEBUG [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/f1/d53deff6e1564e7f9a4b4dcf2158aa82 2018-05-02 06:34:27,621 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,621 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,622 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 51119cebc42546d1c9f2590eec5a49b3 2018-05-02 06:34:27,622 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:34:27,622 INFO [StoreOpener-1fa0746104343e63d4a6c982f8a3bf32-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,622 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,623 INFO [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:34:27,625 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630 2018-05-02 06:34:27,626 DEBUG [PostOpenDeployTasks:3f499471b0415a38ad5efe046913cba2] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:34:27,627 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,627 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opening region: {ENCODED => f61045f3bb8866c33d9b05635d777d75, NAME => 'test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75.', STARTKEY => '(k\xCA\x1A\xF2\x86\xBC\x9C', ENDKEY => '/(k\xCA\x1A\xF2\x86\xB6'} 2018-05-02 06:34:27,628 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AuthenticationService 2018-05-02 06:34:27,628 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,628 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=SecureBulkLoadService 2018-05-02 06:34:27,628 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,628 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,628 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,628 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. service=AccessControlService 2018-05-02 06:34:27,628 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,628 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,629 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:34:27,629 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:34:27,629 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,630 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc 2018-05-02 06:34:27,651 DEBUG [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/f1/a3641d2c563f4968adf6f952315d6af8 2018-05-02 06:34:27,651 INFO [StoreOpener-7386aea828f5bbf6f2bb9358162092e6-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c 2018-05-02 06:34:27,658 DEBUG [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/f1/df553232e0f34ff59749e1f4f7761033 2018-05-02 06:34:27,659 INFO [StoreOpener-685781049fdcc89efe3561b69e4d3810-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,665 DEBUG [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/f1/325853d0d9c94cb6ba31e4bcbf47843e 2018-05-02 06:34:27,665 INFO [StoreOpener-47c574242e461d8e7a12972718bc27ff-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,682 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef 2018-05-02 06:34:27,695 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1/2c6b0a92ce6e4b29b4f5e46b400fa68f 2018-05-02 06:34:27,695 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810 2018-05-02 06:34:27,696 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32 2018-05-02 06:34:27,702 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:34:27,709 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:34:27,712 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:34:27,712 DEBUG [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/test_cf/003bd718e756495284dd200779f4eb8a 2018-05-02 06:34:27,712 INFO [StoreOpener-8c7dd0ad2a67fa6a32d1f3694eef56eb-1] regionserver.HStore: Store=test_cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6 2018-05-02 06:34:27,716 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:34:27,716 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1 2018-05-02 06:34:27,716 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,718 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1 2018-05-02 06:34:27,718 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1 2018-05-02 06:34:27,718 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,719 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,722 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,727 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened 25414d6e395eadb383c40973693beb12; next sequenceid=429 2018-05-02 06:34:27,745 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff 2018-05-02 06:34:27,743 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:34:27,741 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened b8144dc37f351e256653e1454207538f; next sequenceid=420 2018-05-02 06:34:27,732 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened bcf3e62f0ae8e672bee1318720d62930; next sequenceid=420 2018-05-02 06:34:27,769 INFO [PostOpenDeployTasks:b8144dc37f351e256653e1454207538f] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:34:27,769 INFO [PostOpenDeployTasks:bcf3e62f0ae8e672bee1318720d62930] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:34:27,774 INFO [PostOpenDeployTasks:25414d6e395eadb383c40973693beb12] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:34:27,782 DEBUG [PostOpenDeployTasks:b8144dc37f351e256653e1454207538f] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:34:27,782 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opening region: {ENCODED => 7d91c8087e31e21951799651a5262353, NAME => 'test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353.', STARTKEY => '', ENDKEY => '\x00\x00\x00\x00\x00\x00\x00\x00'} 2018-05-02 06:34:27,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AuthenticationService 2018-05-02 06:34:27,783 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,783 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=SecureBulkLoadService 2018-05-02 06:34:27,783 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,783 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,783 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. service=AccessControlService 2018-05-02 06:34:27,784 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,784 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 7d91c8087e31e21951799651a5262353 2018-05-02 06:34:27,784 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:34:27,785 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,787 DEBUG [PostOpenDeployTasks:bcf3e62f0ae8e672bee1318720d62930] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:34:27,787 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,787 DEBUG [PostOpenDeployTasks:25414d6e395eadb383c40973693beb12] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:34:27,787 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,788 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opening region: {ENCODED => 041977f7087dd987f3bc1c3b0d191155, NAME => 'test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155.', STARTKEY => '\x145\xE5\x0DyC^N', ENDKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h'} 2018-05-02 06:34:27,788 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opening region: {ENCODED => 843b3b66a19c1c2d494720e99edc9c52, NAME => 'test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52.', STARTKEY => '/(k\xCA\x1A\xF2\x86\xB6', ENDKEY => '5\xE5\x0DyC^P\xD0'} 2018-05-02 06:34:27,788 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=AuthenticationService 2018-05-02 06:34:27,788 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,788 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=AuthenticationService 2018-05-02 06:34:27,788 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,789 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=SecureBulkLoadService 2018-05-02 06:34:27,789 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,789 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,788 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=SecureBulkLoadService 2018-05-02 06:34:27,789 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,789 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,789 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,789 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. service=AccessControlService 2018-05-02 06:34:27,790 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,790 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,790 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,790 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. service=AccessControlService 2018-05-02 06:34:27,790 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,790 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,791 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 843b3b66a19c1c2d494720e99edc9c52 2018-05-02 06:34:27,791 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:34:27,791 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 041977f7087dd987f3bc1c3b0d191155 2018-05-02 06:34:27,793 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:34:27,794 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,833 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:34:27,845 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:27,852 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened 299c3061e2a10cee5be3bff86a2ec41a; next sequenceid=429 2018-05-02 06:34:27,853 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:34:27,852 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:34:27,874 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened 98abf1ead3bf61c95cc4ffe5e6e5fe96; next sequenceid=417 2018-05-02 06:34:27,854 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] regionserver.HRegion: Opened 46af8f9145c39f07531ceaa92c7f8dbc; next sequenceid=423 2018-05-02 06:34:27,877 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb 2018-05-02 06:34:27,880 DEBUG [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/f1/649450abe53e433192b35544d0e0ab96 2018-05-02 06:34:27,882 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] regionserver.HRegion: Opened bb19a5bd59b1b3dff86020949234aaf5; next sequenceid=417 2018-05-02 06:34:27,884 INFO [PostOpenDeployTasks:299c3061e2a10cee5be3bff86a2ec41a] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:34:27,891 DEBUG [PostOpenDeployTasks:299c3061e2a10cee5be3bff86a2ec41a] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:34:27,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:27,891 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opening region: {ENCODED => 93f2d602c0a0a654856fb16863c2ff38, NAME => 'test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38.', STARTKEY => '\x0DyC^P\xD7\x944', ENDKEY => '\x145\xE5\x0DyC^N'} 2018-05-02 06:34:27,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AuthenticationService 2018-05-02 06:34:27,892 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:27,895 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=SecureBulkLoadService 2018-05-02 06:34:27,896 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:27,896 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:27,896 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:27,897 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. service=AccessControlService 2018-05-02 06:34:27,897 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:27,897 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:27,903 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am 93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:34:27,903 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:34:27,904 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened 3ea52812fafc49b1651e26e1bd43ec97; next sequenceid=420 2018-05-02 06:34:27,906 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:27,917 INFO [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:34:27,930 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:34:27,930 INFO [StoreOpener-530aabaf92e988eadd5338ed38b9be0c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:27,930 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:34:27,937 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:34:27,944 INFO [PostOpenDeployTasks:bb19a5bd59b1b3dff86020949234aaf5] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:34:27,944 INFO [PostOpenDeployTasks:46af8f9145c39f07531ceaa92c7f8dbc] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:34:27,946 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Opened 93aea36f9251cfe49e28f84a517e3630; next sequenceid=426 2018-05-02 06:34:27,946 INFO [PostOpenDeployTasks:3ea52812fafc49b1651e26e1bd43ec97] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:34:27,947 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 06:34:27,947 DEBUG [StoreOpener-7d91c8087e31e21951799651a5262353-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/f1 2018-05-02 06:34:27,948 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:27,948 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:27,955 INFO [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:34:27,968 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opened 1fa0746104343e63d4a6c982f8a3bf32; next sequenceid=420 2018-05-02 06:34:27,976 INFO [PostOpenDeployTasks:1fa0746104343e63d4a6c982f8a3bf32] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:34:28,060 DEBUG [PostOpenDeployTasks:3ea52812fafc49b1651e26e1bd43ec97] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:34:28,060 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,061 DEBUG [PostOpenDeployTasks:98abf1ead3bf61c95cc4ffe5e6e5fe96] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:34:28,061 DEBUG [PostOpenDeployTasks:1fa0746104343e63d4a6c982f8a3bf32] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:34:28,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,061 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,062 DEBUG [PostOpenDeployTasks:46af8f9145c39f07531ceaa92c7f8dbc] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:34:28,062 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-14] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,063 DEBUG [PostOpenDeployTasks:93aea36f9251cfe49e28f84a517e3630] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:34:28,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opening region: {ENCODED => fa24e8d8fdd999d38faae5dbf847c334, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334.', STARTKEY => '\x145\xE5\x0DyC^N', ENDKEY => '\x1A\xF2\x86\xBC\xA1\xAF(h'} 2018-05-02 06:34:28,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opening region: {ENCODED => 41c625158570994727f1c92a8606ca6c, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c.', STARTKEY => '^P\xD7\x945\xE5\x0Dl', ENDKEY => 'e\x0DyC^P\xD7\x86'} 2018-05-02 06:34:28,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AuthenticationService 2018-05-02 06:34:28,064 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:28,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AuthenticationService 2018-05-02 06:34:28,064 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:28,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opening region: {ENCODED => a47cc34ca47759b3fd7bcaa79faebd3d, NAME => 'test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d.', STARTKEY => '<\xA1\xAF(k\xCA\x1A\xEA', ENDKEY => 'C^P\xD7\x945\xE5\x04'} 2018-05-02 06:34:28,065 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=SecureBulkLoadService 2018-05-02 06:34:28,065 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:28,065 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:28,065 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:28,065 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. service=AccessControlService 2018-05-02 06:34:28,067 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:28,067 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:28,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:34:28,067 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:34:28,068 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:28,064 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=SecureBulkLoadService 2018-05-02 06:34:28,076 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:28,076 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:28,076 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:28,076 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. service=AccessControlService 2018-05-02 06:34:28,076 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:28,076 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:28,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode 41c625158570994727f1c92a8606ca6c 2018-05-02 06:34:28,077 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:34:28,077 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:28,065 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=AuthenticationService 2018-05-02 06:34:28,079 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:34:28,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=SecureBulkLoadService 2018-05-02 06:34:28,079 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:34:28,079 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:34:28,079 INFO [StoreOpener-7d91c8087e31e21951799651a5262353-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:28,079 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:34:28,079 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. service=AccessControlService 2018-05-02 06:34:28,080 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1 2018-05-02 06:34:28,080 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1 2018-05-02 06:34:28,080 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:34:28,080 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:34:28,080 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am-namenode a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:34:28,080 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:34:28,080 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:34:28,081 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:28,083 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:34:28,082 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:28,082 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:28,081 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] regionserver.HRegion: Opened 166b9a4d8133a32343e23907c3228d62; next sequenceid=426 2018-05-02 06:34:28,085 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1 2018-05-02 06:34:28,085 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1 2018-05-02 06:34:28,081 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:28,085 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:28,085 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:28,086 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:28,086 DEBUG [PostOpenDeployTasks:bb19a5bd59b1b3dff86020949234aaf5] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:34:28,086 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-9] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,099 INFO [PostOpenDeployTasks:166b9a4d8133a32343e23907c3228d62] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:34:28,102 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] regionserver.HRegion: Opened 685781049fdcc89efe3561b69e4d3810; next sequenceid=429 2018-05-02 06:34:28,103 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] regionserver.HRegion: Opened 5fc7cfd582bc270c530fe9787011078c; next sequenceid=423 2018-05-02 06:34:28,104 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] regionserver.HRegion: Opened 6e9424b67ac115dc3547de9b3eb4c5ef; next sequenceid=423 2018-05-02 06:34:28,105 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c 2018-05-02 06:34:28,106 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] regionserver.HRegion: Opened 7386aea828f5bbf6f2bb9358162092e6; next sequenceid=423 2018-05-02 06:34:28,106 DEBUG [PostOpenDeployTasks:166b9a4d8133a32343e23907c3228d62] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:34:28,106 INFO [PostOpenDeployTasks:5fc7cfd582bc270c530fe9787011078c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:34:28,106 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-6] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,108 INFO [PostOpenDeployTasks:6e9424b67ac115dc3547de9b3eb4c5ef] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:34:28,113 DEBUG [PostOpenDeployTasks:5fc7cfd582bc270c530fe9787011078c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:34:28,114 INFO [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:34:28,114 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-5] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,121 DEBUG [PostOpenDeployTasks:6e9424b67ac115dc3547de9b3eb4c5ef] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:34:28,122 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-7] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,338 INFO [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:34:28,340 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/23f180c1403c423b8d56e773059b77f3 2018-05-02 06:34:28,341 DEBUG [PostOpenDeployTasks:685781049fdcc89efe3561b69e4d3810] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:34:28,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-15] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,341 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:34:28,342 INFO [sync.3] wal.AbstractFSWAL: Slow sync cost: 224 ms, current pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.70.17:1019,DS-20072b11-ec3a-426b-b4bd-1863dc9de65e,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK]] 2018-05-02 06:34:28,345 DEBUG [PostOpenDeployTasks:7386aea828f5bbf6f2bb9358162092e6] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:34:28,346 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-18] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,367 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:34:28,367 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1 2018-05-02 06:34:28,369 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] regionserver.HRegion: Opened 47c574242e461d8e7a12972718bc27ff; next sequenceid=429 2018-05-02 06:34:28,371 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:34:28,371 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1 2018-05-02 06:34:28,372 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:28,372 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:28,377 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:34:28,377 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1 2018-05-02 06:34:28,378 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:28,378 INFO [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:34:28,379 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:28,388 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/7f6cc973fc9141ee84218d1cf4abc1f2 2018-05-02 06:34:28,394 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1 2018-05-02 06:34:28,394 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1 2018-05-02 06:34:28,396 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:28,397 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:28,436 DEBUG [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/f1/21db71a596184e8987d3b0a857d2a3d8 2018-05-02 06:34:28,437 INFO [StoreOpener-843b3b66a19c1c2d494720e99edc9c52-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:28,446 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=1, currentSize=156.32 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=156.32 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:34:28,447 DEBUG [PostOpenDeployTasks:47c574242e461d8e7a12972718bc27ff] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:34:28,447 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-12] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,447 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:34:28,450 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:34:28,453 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353 2018-05-02 06:34:28,454 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] regionserver.HRegion: Opened 530aabaf92e988eadd5338ed38b9be0c; next sequenceid=417 2018-05-02 06:34:28,460 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52 2018-05-02 06:34:28,461 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12813.seqid, newMaxSeqId=12813, maxSeqId=12812 2018-05-02 06:34:28,464 INFO [PostOpenDeployTasks:530aabaf92e988eadd5338ed38b9be0c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:34:28,469 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened 8c7dd0ad2a67fa6a32d1f3694eef56eb; next sequenceid=12813 2018-05-02 06:34:28,472 DEBUG [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/f1/f817097956b04d90a34738b22c734e7a 2018-05-02 06:34:28,472 INFO [StoreOpener-fa24e8d8fdd999d38faae5dbf847c334-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:28,472 INFO [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:34:28,473 DEBUG [PostOpenDeployTasks:530aabaf92e988eadd5338ed38b9be0c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:34:28,474 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-16] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,481 DEBUG [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/f1/f62905fc6764413996ad23803ef34639 2018-05-02 06:34:28,481 INFO [StoreOpener-041977f7087dd987f3bc1c3b0d191155-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:28,482 DEBUG [PostOpenDeployTasks:8c7dd0ad2a67fa6a32d1f3694eef56eb] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:34:28,482 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,489 DEBUG [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/f1/d5ac413ba8334de5a72f01d06da0f43f 2018-05-02 06:34:28,489 INFO [StoreOpener-f61045f3bb8866c33d9b05635d777d75-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:28,491 DEBUG [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/f1/ad174b44a0ea459c97ae086ef4638f39 2018-05-02 06:34:28,491 INFO [StoreOpener-51119cebc42546d1c9f2590eec5a49b3-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:28,498 DEBUG [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/f1/fd27d9b977b54177a8fb19407a54184c 2018-05-02 06:34:28,498 INFO [StoreOpener-a47cc34ca47759b3fd7bcaa79faebd3d-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:28,500 DEBUG [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/f1/01824852ca574c54a2a33f4964ca59ec 2018-05-02 06:34:28,500 INFO [StoreOpener-41c625158570994727f1c92a8606ca6c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:28,504 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334 2018-05-02 06:34:28,507 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155 2018-05-02 06:34:28,518 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75 2018-05-02 06:34:28,530 DEBUG [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/f1/da3881a0cb0542f0a0fdfe2ffd2e6aba 2018-05-02 06:34:28,530 INFO [StoreOpener-93f2d602c0a0a654856fb16863c2ff38-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:34:28,534 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3 2018-05-02 06:34:28,535 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d 2018-05-02 06:34:28,537 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c 2018-05-02 06:34:28,544 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:34:28,551 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38 2018-05-02 06:34:28,557 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] regionserver.HRegion: Opened 843b3b66a19c1c2d494720e99edc9c52; next sequenceid=420 2018-05-02 06:34:28,568 INFO [PostOpenDeployTasks:843b3b66a19c1c2d494720e99edc9c52] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:34:28,589 DEBUG [PostOpenDeployTasks:843b3b66a19c1c2d494720e99edc9c52] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:34:28,590 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-11] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,603 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:34:28,607 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] regionserver.HRegion: Opened fa24e8d8fdd999d38faae5dbf847c334; next sequenceid=417 2018-05-02 06:34:28,635 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:34:28,636 INFO [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:34:28,640 DEBUG [PostOpenDeployTasks:fa24e8d8fdd999d38faae5dbf847c334] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:34:28,640 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-13] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,643 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Opened f61045f3bb8866c33d9b05635d777d75; next sequenceid=426 2018-05-02 06:34:28,644 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:28,644 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/420.seqid, newMaxSeqId=420, maxSeqId=419 2018-05-02 06:34:28,648 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/recovered.edits/423.seqid, newMaxSeqId=423, maxSeqId=422 2018-05-02 06:34:28,648 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/429.seqid, newMaxSeqId=429, maxSeqId=428 2018-05-02 06:34:28,652 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/17.seqid, newMaxSeqId=17, maxSeqId=16 2018-05-02 06:34:28,652 INFO [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:34:28,653 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/recovered.edits/417.seqid, newMaxSeqId=417, maxSeqId=416 2018-05-02 06:34:28,654 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] regionserver.HRegion: Opened 93f2d602c0a0a654856fb16863c2ff38; next sequenceid=429 2018-05-02 06:34:28,654 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] regionserver.HRegion: Opened 041977f7087dd987f3bc1c3b0d191155; next sequenceid=423 2018-05-02 06:34:28,654 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] regionserver.HRegion: Opened 41c625158570994727f1c92a8606ca6c; next sequenceid=420 2018-05-02 06:34:28,656 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] regionserver.HRegion: Opened 7d91c8087e31e21951799651a5262353; next sequenceid=17 2018-05-02 06:34:28,662 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] regionserver.HRegion: Opened a47cc34ca47759b3fd7bcaa79faebd3d; next sequenceid=417 2018-05-02 06:34:28,662 DEBUG [PostOpenDeployTasks:f61045f3bb8866c33d9b05635d777d75] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:34:28,662 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,670 INFO [PostOpenDeployTasks:041977f7087dd987f3bc1c3b0d191155] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:34:28,670 INFO [PostOpenDeployTasks:a47cc34ca47759b3fd7bcaa79faebd3d] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:34:28,672 INFO [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:34:28,674 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] regionserver.HRegion: Opened 51119cebc42546d1c9f2590eec5a49b3; next sequenceid=423 2018-05-02 06:34:28,677 INFO [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:34:28,682 DEBUG [PostOpenDeployTasks:a47cc34ca47759b3fd7bcaa79faebd3d] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:34:28,682 DEBUG [PostOpenDeployTasks:41c625158570994727f1c92a8606ca6c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:34:28,682 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-4] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,682 DEBUG [PostOpenDeployTasks:041977f7087dd987f3bc1c3b0d191155] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:34:28,682 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-17] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,682 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-8] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,684 DEBUG [PostOpenDeployTasks:7d91c8087e31e21951799651a5262353] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:34:28,685 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-3] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,688 INFO [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:34:28,698 DEBUG [PostOpenDeployTasks:93f2d602c0a0a654856fb16863c2ff38] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:34:28,698 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-10] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,705 INFO [PostOpenDeployTasks:51119cebc42546d1c9f2590eec5a49b3] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:34:28,715 DEBUG [PostOpenDeployTasks:51119cebc42546d1c9f2590eec5a49b3] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:34:28,715 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-19] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:34:28,831 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:34:28,833 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:34:29,011 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:34:29,011 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:34:29,011 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:34:29,040 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:34:29,049 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:34:29,049 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:34:30,129 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:34:30,130 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:34:30,130 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:30,133 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:34:30,135 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:30,135 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:34:30,137 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:30,137 DEBUG [RS-EventLoopGroup-1-5] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:34:30,138 DEBUG [RS-EventLoopGroup-1-5] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:34:30,145 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:34:30,147 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:34:30,147 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:30,150 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:34:30,151 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:30,152 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:34:30,155 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:34:30,155 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:34:30,155 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:34:32,134 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:34:32,135 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:34:32,138 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:34:32,211 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:34:32,644 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:34:33,278 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:34:33,279 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:34:33,362 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:34:33,362 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:34:33,362 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:34:33,401 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:34:33,404 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:34:33,404 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:34:52,336 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:35:05,079 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3ebca82d-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:35:05,079 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x3ebca82d] zookeeper.ZooKeeper: Session: 0x3631f08b27900c9 closed 2018-05-02 06:35:05,985 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.378 minutes, events=16, succcessCount=8, totalEvents=16, totalSuccessCount=8 2018-05-02 06:35:08,271 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:36:10,686 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963 2018-05-02 06:36:10,690 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963 znode expired, triggering replicatorRemoved event 2018-05-02 06:36:10,690 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:36:11,396 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 2018-05-02 06:36:11,399 INFO [main-EventThread] replication.ReplicationTrackerZKImpl: /hbase-secure/rs/ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683 znode expired, triggering replicatorRemoved event 2018-05-02 06:36:11,399 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs Wed May 2 06:36:11 UTC 2018 Terminating regionserver 2018-05-02 06:36:11,817 INFO [pool-7-thread-1] provider.AuditProviderFactory: ==> JVMShutdownHook.run() 2018-05-02 06:36:11,817 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Signalling async audit cleanup to start. 2018-05-02 06:36:11,817 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Starting cleanup 2018-05-02 06:36:11,818 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Stop called. name=hbaseRegional.async 2018-05-02 06:36:11,818 INFO [Ranger async Audit cleanup] queue.AuditAsyncQueue: Interrupting consumerThread. name=hbaseRegional.async, consumer=hbaseRegional.async.summary 2018-05-02 06:36:11,818 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Done cleanup 2018-05-02 06:36:11,818 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:36:11,818 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Waiting up to 30 seconds for audit cleanup to finish. 2018-05-02 06:36:11,818 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Audit cleanup finished after 0 milli seconds 2018-05-02 06:36:11,818 INFO [pool-7-thread-1] provider.AuditProviderFactory: JVMShutdownHook: Interrupting ranger async audit cleanup thread 2018-05-02 06:36:11,818 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Interrupted while waiting for audit startCleanup signal! Exiting the thread... java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:998) at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304) at java.util.concurrent.Semaphore.acquire(Semaphore.java:312) at org.apache.ranger.audit.provider.AuditProviderFactory$RangerAsyncAuditCleanup.run(AuditProviderFactory.java:495) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:36:11,819 INFO [pool-7-thread-1] provider.AuditProviderFactory: <== JVMShutdownHook.run() 2018-05-02 06:36:11,823 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer@782bf610 2018-05-02 06:36:11,824 INFO [pool-7-thread-1] regionserver.HRegionServer: ***** STOPPING region server 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009' ***** 2018-05-02 06:36:11,825 INFO [pool-7-thread-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,826 DEBUG [pool-7-thread-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:11,826 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting polling loop. name=hbaseRegional.async 2018-05-02 06:36:11,826 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Calling to stop consumer. name=hbaseRegional.async, consumer.name=hbaseRegional.async.summary 2018-05-02 06:36:11,826 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Stop called. name=hbaseRegional.async.summary 2018-05-02 06:36:11,826 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditSummaryQueue: Interrupting consumerThread. name=hbaseRegional.async.summary, consumer=hbaseRegional.async.summary.batch 2018-05-02 06:36:11,826 INFO [org.apache.ranger.audit.queue.AuditAsyncQueue0] queue.AuditAsyncQueue: Exiting consumerThread.run() method. name=hbaseRegional.async 2018-05-02 06:36:11,827 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting polling loop. name=hbaseRegional.async.summary 2018-05-02 06:36:11,827 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Calling to stop consumer. name=hbaseRegional.async.summary, consumer.name=hbaseRegional.async.summary.batch 2018-05-02 06:36:11,827 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Stop called. name=hbaseRegional.async.summary.batch 2018-05-02 06:36:11,827 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=02:06.328 minutes, events=8, succcessCount=8, totalEvents=8, totalSuccessCount=8 2018-05-02 06:36:11,827 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditBatchQueue: Interrupting consumerThread. name=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:11,827 INFO [org.apache.ranger.audit.queue.AuditSummaryQueue0] queue.AuditSummaryQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary 2018-05-02 06:36:11,842 INFO [pool-7-thread-1] regionserver.HRegionServer: STOPPED: Shutdown hook 2018-05-02 06:36:11,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: Sending interrupt to stop the worker thread 2018-05-02 06:36:11,843 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Stopping infoServer 2018-05-02 06:36:11,845 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker interrupted. Exiting. 2018-05-02 06:36:11,845 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 exiting 2018-05-02 06:36:11,851 WARN [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: failed to log audit event: {"repoType":2,"repo":"cl1_hbase","reqUser":"hbase","evtTime":"2018-05-02 06:36:11.825","access":"stop","action":"admin","result":1,"policy":-1,"enforcer":"ranger-acl","agentHost":"ctr-e138-1518143905142-279227-01-000002.hwx.site","logType":"RangerAudit","id":"bedb5ad8-87a9-4db7-bdfe-6f38d55929da-70","seq_num":141,"event_count":1,"event_dur_ms":1,"tags":[],"cluster_name":"cl1"} org.apache.solr.common.SolrException: Could not load collection from ZK: ranger_audits at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1101) at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:638) at org.apache.solr.client.solrj.impl.CloudSolrClient.getDocCollection(CloudSolrClient.java:1489) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1099) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1073) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:160) at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:106) at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:71) at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:85) at org.apache.ranger.audit.utils.SolrAppUtil$1.run(SolrAppUtil.java:35) at org.apache.ranger.audit.utils.SolrAppUtil$1.run(SolrAppUtil.java:32) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682) at org.apache.ranger.audit.provider.MiscUtil.executePrivilegedAction(MiscUtil.java:523) at org.apache.ranger.audit.utils.SolrAppUtil.addDocsToSolr(SolrAppUtil.java:32) at org.apache.ranger.audit.destination.SolrAuditDestination.log(SolrAuditDestination.java:225) at org.apache.ranger.audit.queue.AuditBatchQueue.runLogAudit(AuditBatchQueue.java:309) at org.apache.ranger.audit.queue.AuditBatchQueue.run(AuditBatchQueue.java:215) at java.lang.Thread.run(Thread.java:748) Caused by: java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1386) at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1153) at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357) at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354) at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1110) at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1096) ... 19 more 2018-05-02 06:36:11,862 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337 2018-05-02 06:36:11,871 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/rs 2018-05-02 06:36:11,871 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Switching to file spool. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:11,882 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.w.WebAppContext@14a049f9{/,null,UNAVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:36:11,886 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Creating new file. queueName=hbaseRegional.async.summary.batch, fileName=spool_hbaseRegional_20180502-0636.11.log 2018-05-02 06:36:11,905 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] server.AbstractConnector: Stopped ServerConnector@1caa9eb6{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:36:11,905 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,UNAVAILABLE} 2018-05-02 06:36:11,905 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] handler.ContextHandler: Stopped o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,UNAVAILABLE} 2018-05-02 06:36:11,906 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread. Queue=hbaseRegional.async.summary.batch, dest=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:11,906 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Calling to stop consumer. name=hbaseRegional.async.summary.batch, consumer.name=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:11,906 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch.solr, interval=079 milli-seconds, events=1, failedCount=1, totalEvents=9, totalSuccessCount=8, totalFailedCount=1 2018-05-02 06:36:11,906 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Stop called, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:11,906 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditFileSpool: Closing open file, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:36:11,908 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Caught exception in consumer thread. Shutdown might be in progress 2018-05-02 06:36:11,908 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=05.877 seconds, events=1, stashedCount=1, totalEvents=17, totalSuccessCount=8, totalStashedCount=1 2018-05-02 06:36:11,909 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] queue.AuditBatchQueue: Exiting consumerThread.run() method. name=hbaseRegional.async.summary.batch 2018-05-02 06:36:11,925 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Stopping 2018-05-02 06:36:11,926 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher: MemStoreFlusher.0 exiting 2018-05-02 06:36:11,926 INFO [MemStoreFlusher.1] regionserver.MemStoreFlusher: MemStoreFlusher.1 exiting 2018-05-02 06:36:11,926 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Stopping region server flush procedure manager gracefully. 2018-05-02 06:36:11,927 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Stopping RegionServerSnapshotManager gracefully. 2018-05-02 06:36:11,928 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,940 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,943 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 041977f7087dd987f3bc1c3b0d191155, disabling compactions & flushes 2018-05-02 06:36:11,944 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:36:11,961 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,963 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,963 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing ce3059196e012fe2ffadcb5d2b348ce3, disabling compactions & flushes 2018-05-02 06:36:11,963 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:36:11,975 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,977 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,978 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,978 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,979 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,979 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,979 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,980 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,982 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,983 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,983 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,988 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:11,999 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,001 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 299c3061e2a10cee5be3bff86a2ec41a, disabling compactions & flushes 2018-05-02 06:36:12,001 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:36:12,001 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,003 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,003 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,003 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,004 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,004 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,004 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,005 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,005 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,005 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,006 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,006 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,006 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,007 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,008 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,009 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,009 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,009 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,010 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,010 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,012 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,012 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,013 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,013 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,013 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,014 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,014 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,014 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,015 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,015 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,016 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,016 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,016 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,017 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,017 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,017 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,018 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,018 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,019 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,019 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,020 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,020 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,020 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,021 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,021 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,022 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,023 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,023 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,024 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,024 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,025 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,025 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,025 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,026 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,026 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,027 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,027 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,027 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:36:12,027 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.MetaTableLocator: Stopping MetaTableLocator 2018-05-02 06:36:12,028 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Close zookeeper connection 0x3ebca82d to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:36:12,028 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:36:12,028 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Split Thread to finish... 2018-05-02 06:36:12,028 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Large Compaction Thread to finish... 2018-05-02 06:36:12,028 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.CompactSplit: Waiting for Small Compaction Thread to finish... 2018-05-02 06:36:12,028 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,042 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,043 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 1588230740, disabling compactions & flushes 2018-05-02 06:36:12,043 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region hbase:meta,,1.1588230740 2018-05-02 06:36:12,044 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Flushing 2/2 column families, memstore data size=170.50 KB memstore heap size=249.76 KB 2018-05-02 06:36:12,051 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 73 regions to close 2018-05-02 06:36:12,186 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/ce3059196e012fe2ffadcb5d2b348ce3/recovered.edits/12824.seqid, newMaxSeqId=12824, maxSeqId=12822 2018-05-02 06:36:12,194 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/041977f7087dd987f3bc1c3b0d191155/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:12,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,195 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,197 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:36:12,197 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,0a3d70a3,1525238855422.ce3059196e012fe2ffadcb5d2b348ce3. 2018-05-02 06:36:12,197 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,198 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/299c3061e2a10cee5be3bff86a2ec41a/recovered.edits/431.seqid, newMaxSeqId=431, maxSeqId=429 2018-05-02 06:36:12,198 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 2fd8c4d5abf9928da8e8c547a0ca223a, disabling compactions & flushes 2018-05-02 06:36:12,199 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:36:12,200 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,200 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,200 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,200 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:36:12,200 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x145\xE5\x0DyC^N,1525239890069.041977f7087dd987f3bc1c3b0d191155. 2018-05-02 06:36:12,200 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 931a5308337d39ab8fcac37d3a5e5844, disabling compactions & flushes 2018-05-02 06:36:12,201 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:36:12,204 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,204 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,204 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,205 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:36:12,205 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xB5\xE5\x0DyC^P\xBE,1525239890069.299c3061e2a10cee5be3bff86a2ec41a. 2018-05-02 06:36:12,205 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,206 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 5de3546305c82231844eb840c6cfa983, disabling compactions & flushes 2018-05-02 06:36:12,206 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:36:12,275 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/931a5308337d39ab8fcac37d3a5e5844/recovered.edits/12470.seqid, newMaxSeqId=12470, maxSeqId=12468 2018-05-02 06:36:12,276 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/2fd8c4d5abf9928da8e8c547a0ca223a/recovered.edits/12335.seqid, newMaxSeqId=12335, maxSeqId=12333 2018-05-02 06:36:12,286 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,286 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,286 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,286 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:36:12,286 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5de3546305c82231844eb840c6cfa983/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:12,286 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,9999998d,1525237868269.2fd8c4d5abf9928da8e8c547a0ca223a. 2018-05-02 06:36:12,286 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,287 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:36:12,287 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,28f5c28c,1525238855422.931a5308337d39ab8fcac37d3a5e5844. 2018-05-02 06:36:12,288 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,288 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 1d954f21d711345a9587d995cecea136, disabling compactions & flushes 2018-05-02 06:36:12,288 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:36:12,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,290 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,290 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:36:12,291 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xF9C^P\xD7\x945\xC2,1525239890069.5de3546305c82231844eb840c6cfa983. 2018-05-02 06:36:12,291 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,291 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing a1d694475a6981010a6489a33c4db464, disabling compactions & flushes 2018-05-02 06:36:12,291 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:36:12,301 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing b8144dc37f351e256653e1454207538f, disabling compactions & flushes 2018-05-02 06:36:12,301 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:36:12,335 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.leaseChecker] regionserver.Leases: Closed leases 2018-05-02 06:36:12,368 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/b8144dc37f351e256653e1454207538f/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:36:12,369 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/a1d694475a6981010a6489a33c4db464/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:36:12,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,375 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:36:12,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD7\x945\xE5\x0DyC@,1525239890069.a1d694475a6981010a6489a33c4db464. 2018-05-02 06:36:12,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,376 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:36:12,376 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xE5\x0DyC^P\xD7t,1525241408832.b8144dc37f351e256653e1454207538f. 2018-05-02 06:36:12,376 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1d954f21d711345a9587d995cecea136/recovered.edits/12562.seqid, newMaxSeqId=12562, maxSeqId=12560 2018-05-02 06:36:12,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 166b9a4d8133a32343e23907c3228d62, disabling compactions & flushes 2018-05-02 06:36:12,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:36:12,376 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing a58d4c86d2df306cc460a231fd5a1ac1, disabling compactions & flushes 2018-05-02 06:36:12,377 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:36:12,387 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,387 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,387 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,387 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:36:12,388 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,a3d70a30,1525237868269.1d954f21d711345a9587d995cecea136. 2018-05-02 06:36:12,388 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,389 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 1182d8ac9fbcff5334cd5fda2cf0c4a0, disabling compactions & flushes 2018-05-02 06:36:12,389 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:36:12,422 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/166b9a4d8133a32343e23907c3228d62/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:36:12,439 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,439 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,439 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,440 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:36:12,440 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,<\xA1\xAF(k\xCA\x1A\xEA,1525239890069.166b9a4d8133a32343e23907c3228d62. 2018-05-02 06:36:12,440 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,441 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 022c10bc256d7e8dc5d475d7ff8545ea, disabling compactions & flushes 2018-05-02 06:36:12,441 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:36:12,463 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/1182d8ac9fbcff5334cd5fda2cf0c4a0/recovered.edits/13664.seqid, newMaxSeqId=13664, maxSeqId=13662 2018-05-02 06:36:12,475 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,476 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,476 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,476 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:36:12,476 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,1eb851e9,1525237868269.1182d8ac9fbcff5334cd5fda2cf0c4a0. 2018-05-02 06:36:12,476 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,477 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 25414d6e395eadb383c40973693beb12, disabling compactions & flushes 2018-05-02 06:36:12,477 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:36:12,494 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.DefaultStoreFlusher: Flushed memstore data size=170.50 KB at sequenceid=3166 (bloomFilter=false), to=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/2e9a119565314b11b7defc35c2e8edf1 2018-05-02 06:36:12,515 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a58d4c86d2df306cc460a231fd5a1ac1/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:12,515 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/022c10bc256d7e8dc5d475d7ff8545ea/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:12,537 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,537 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,537 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,538 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:36:12,538 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525241408832.022c10bc256d7e8dc5d475d7ff8545ea. 2018-05-02 06:36:12,538 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,539 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 89df5caac424c7424fede4183c6dce19, disabling compactions & flushes 2018-05-02 06:36:12,539 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:36:12,541 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,541 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,541 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,541 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:36:12,541 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xD7\x945\xE5\x0DyC@,1525241408832.a58d4c86d2df306cc460a231fd5a1ac1. 2018-05-02 06:36:12,542 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing b89f4262e34dfdd1fbea3661f9d50263, disabling compactions & flushes 2018-05-02 06:36:12,542 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:36:12,571 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegionFileSystem: Committing hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/.tmp/info/2e9a119565314b11b7defc35c2e8edf1 as hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/2e9a119565314b11b7defc35c2e8edf1 2018-05-02 06:36:12,575 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/25414d6e395eadb383c40973693beb12/recovered.edits/431.seqid, newMaxSeqId=431, maxSeqId=429 2018-05-02 06:36:12,582 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/89df5caac424c7424fede4183c6dce19/recovered.edits/431.seqid, newMaxSeqId=431, maxSeqId=429 2018-05-02 06:36:12,614 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,614 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,614 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,614 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:36:12,615 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:12,615 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:12,615 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:12,615 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x7F\xFF\xFF\xFF\xFF\xFF\xFF\xEE,1525239890069.25414d6e395eadb383c40973693beb12. 2018-05-02 06:36:12,615 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:36:12,615 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,615 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 1bf9126ca1d7eb9abb934165d5f25857, disabling compactions & flushes 2018-05-02 06:36:12,615 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:36:12,616 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xE5\x0DyC^P\xD7t,1525239890069.89df5caac424c7424fede4183c6dce19. 2018-05-02 06:36:12,616 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:12,616 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing ffde9f4a59ab08d4830f3b671f736ad5, disabling compactions & flushes 2018-05-02 06:36:12,616 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:36:12,727 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242849572 2018-05-02 06:36:12,793 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] hbase.ScheduledChore: Chore: MemstoreFlusherChore was stopped 2018-05-02 06:36:12,794 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] hbase.ScheduledChore: Chore: MovedRegionsCleaner for region ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 was stopped 2018-05-02 06:36:12,794 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.Chore.1] hbase.ScheduledChore: Chore: CompactedHFilesCleaner was stopped 2018-05-02 06:36:13,003 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/acl/b89f4262e34dfdd1fbea3661f9d50263/recovered.edits/40.seqid, newMaxSeqId=40, maxSeqId=38 2018-05-02 06:36:13,007 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,007 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,007 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,007 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:36:13,008 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed hbase:acl,,1525237104557.b89f4262e34dfdd1fbea3661f9d50263. 2018-05-02 06:36:13,008 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,008 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 7b44edd79044515d04eb08298b1e52e9, disabling compactions & flushes 2018-05-02 06:36:13,008 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:36:13,016 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1155 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063014, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,016 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=4,queue=0,port=16020] ipc.RpcServer: callId: 1152 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063013, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,016 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=8,queue=0,port=16020] ipc.RpcServer: callId: 1156 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063014, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,017 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1153 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063014, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,017 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1154 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063014, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,018 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=16,queue=0,port=16020] ipc.RpcServer: callId: 1157 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063017, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,021 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=15,queue=1,port=16020] ipc.RpcServer: callId: 1158 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063019, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,023 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=10,queue=0,port=16020] ipc.RpcServer: callId: 1160 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063023, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,023 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1161 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063023, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,024 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=17,queue=1,port=16020] ipc.RpcServer: callId: 1162 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063023, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,024 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=18,queue=0,port=16020] ipc.RpcServer: callId: 1159 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063022, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,025 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=6,queue=0,port=16020] ipc.RpcServer: callId: 1163 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063024, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,026 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 1164 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063025, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,027 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=17,queue=1,port=16020] ipc.RpcServer: callId: 1165 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063027, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,029 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=17,queue=1,port=16020] ipc.RpcServer: callId: 1166 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063028, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,029 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1167 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063029, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,030 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1bf9126ca1d7eb9abb934165d5f25857/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:36:13,030 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/ffde9f4a59ab08d4830f3b671f736ad5/recovered.edits/12007.seqid, newMaxSeqId=12007, maxSeqId=12005 2018-05-02 06:36:13,033 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HStore: Added hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/info/2e9a119565314b11b7defc35c2e8edf1, entries=1072, sequenceid=3166, filesize=181.7 K 2018-05-02 06:36:13,040 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,040 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,040 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,040 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:36:13,040 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x945\xE5\x0DyC^<,1525241408832.1bf9126ca1d7eb9abb934165d5f25857. 2018-05-02 06:36:13,041 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,042 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 28608f50f9f828e7d3ab571a72b0d5f3, disabling compactions & flushes 2018-05-02 06:36:13,042 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:36:13,044 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,044 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,044 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,044 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:36:13,044 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ccccccbc,1525237868269.ffde9f4a59ab08d4830f3b671f736ad5. 2018-05-02 06:36:13,045 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,048 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 19c6e3a27177cc57e6cf72ac907048ed, disabling compactions & flushes 2018-05-02 06:36:13,048 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:36:13,064 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 55 regions to close 2018-05-02 06:36:13,104 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7b44edd79044515d04eb08298b1e52e9/recovered.edits/431.seqid, newMaxSeqId=431, maxSeqId=429 2018-05-02 06:36:13,113 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Finished memstore flush; data size ~170.50 KB/174594, heap size ~249.97 KB/255968, currentsize=0 B/0 for 1588230740 in 1069ms, sequenceid=3166, compaction requested=true 2018-05-02 06:36:13,128 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,129 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,129 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,129 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:36:13,133 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/19c6e3a27177cc57e6cf72ac907048ed/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:36:13,137 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,r\x86\xBC\xA1\xAF(k\xBA,1525239890069.7b44edd79044515d04eb08298b1e52e9. 2018-05-02 06:36:13,137 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 843b3b66a19c1c2d494720e99edc9c52, disabling compactions & flushes 2018-05-02 06:36:13,138 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:36:13,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,141 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,142 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,142 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:36:13,143 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x9A\xF2\x86\xBC\xA1\xAF(V,1525241408832.19c6e3a27177cc57e6cf72ac907048ed. 2018-05-02 06:36:13,143 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,144 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 681566c13ee68fa7a27c4bd39d5a79e0, disabling compactions & flushes 2018-05-02 06:36:13,144 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:36:13,151 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/28608f50f9f828e7d3ab571a72b0d5f3/recovered.edits/12039.seqid, newMaxSeqId=12039, maxSeqId=12037 2018-05-02 06:36:13,151 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1168 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063151, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,152 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1183 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063151, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,155 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,155 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:36:13,156 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,51eb8518,1525238855422.28608f50f9f828e7d3ab571a72b0d5f3. 2018-05-02 06:36:13,156 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,157 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 735f841820ff0baa687bc402b169f4a6, disabling compactions & flushes 2018-05-02 06:36:13,157 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:36:13,176 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1182 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063176, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,177 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1181 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063177, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,201 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1180 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063192, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,201 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1179 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063192, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,206 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1178 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063206, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,208 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1170 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063207, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,209 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1177 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063208, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,210 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1176 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063210, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,211 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1175 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063211, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,212 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1174 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063212, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,214 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1173 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063213, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,215 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1172 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063214, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,216 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1171 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063216, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,219 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1169 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063216, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,246 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/681566c13ee68fa7a27c4bd39d5a79e0/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:13,250 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,250 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,250 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,250 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:36:13,250 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xF2\x86\xBC\xA1\xAF(k\xA8,1525239890069.681566c13ee68fa7a27c4bd39d5a79e0. 2018-05-02 06:36:13,251 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing e8edde5a00b30c080b02d1b096794b39, disabling compactions & flushes 2018-05-02 06:36:13,251 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:36:13,258 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/meta/1588230740/recovered.edits/3169.seqid, newMaxSeqId=3169, maxSeqId=2896 2018-05-02 06:36:13,265 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,265 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2018-05-02 06:36:13,265 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,265 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,265 INFO [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed hbase:meta,,1.1588230740 2018-05-02 06:36:13,265 DEBUG [RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed hbase:meta,,1.1588230740 2018-05-02 06:36:13,278 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/843b3b66a19c1c2d494720e99edc9c52/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:36:13,281 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,281 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,281 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,281 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:36:13,281 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,/(k\xCA\x1A\xF2\x86\xB6,1525239890069.843b3b66a19c1c2d494720e99edc9c52. 2018-05-02 06:36:13,282 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 59a7b13a4cf2cd2376c378f77087088d, disabling compactions & flushes 2018-05-02 06:36:13,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:36:13,285 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/735f841820ff0baa687bc402b169f4a6/recovered.edits/12251.seqid, newMaxSeqId=12251, maxSeqId=12249 2018-05-02 06:36:13,293 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,293 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,293 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,293 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:36:13,294 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,9999998d,1525238855422.735f841820ff0baa687bc402b169f4a6. 2018-05-02 06:36:13,294 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,294 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 93a15c4ca6299bea02a86ac40494d75a, disabling compactions & flushes 2018-05-02 06:36:13,294 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:36:13,307 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/e8edde5a00b30c080b02d1b096794b39/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:36:13,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,318 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:36:13,318 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xC3^P\xD7\x945\xE4\xF2,1525241408832.e8edde5a00b30c080b02d1b096794b39. 2018-05-02 06:36:13,319 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,319 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 98abf1ead3bf61c95cc4ffe5e6e5fe96, disabling compactions & flushes 2018-05-02 06:36:13,319 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:36:13,345 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93a15c4ca6299bea02a86ac40494d75a/recovered.edits/19.seqid, newMaxSeqId=19, maxSeqId=17 2018-05-02 06:36:13,346 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/59a7b13a4cf2cd2376c378f77087088d/recovered.edits/12448.seqid, newMaxSeqId=12448, maxSeqId=12446 2018-05-02 06:36:13,349 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,349 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,349 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,349 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:36:13,349 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,,1525241408832.93a15c4ca6299bea02a86ac40494d75a. 2018-05-02 06:36:13,350 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,350 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 51969dda9dfa8895c283f334f944e248, disabling compactions & flushes 2018-05-02 06:36:13,350 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:36:13,353 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,353 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,353 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,353 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:36:13,353 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3d70a3d2,1525238855422.59a7b13a4cf2cd2376c378f77087088d. 2018-05-02 06:36:13,354 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,354 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 665f3f34ec072c60acee3dc78af73b62, disabling compactions & flushes 2018-05-02 06:36:13,354 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:36:13,381 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/98abf1ead3bf61c95cc4ffe5e6e5fe96/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:36:13,383 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1185 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063382, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,383 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1184 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063383, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,386 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,387 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,387 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,387 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:36:13,387 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,C^P\xD7\x945\xE5\x04,1525241408832.98abf1ead3bf61c95cc4ffe5e6e5fe96. 2018-05-02 06:36:13,387 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,388 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 29fe0b7866912efc70bb3f2d7fd83059, disabling compactions & flushes 2018-05-02 06:36:13,388 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:36:13,450 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1189 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063449, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,459 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1186 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063449, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,460 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1188 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063460, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,461 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1190 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063461, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,465 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1191 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063461, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,466 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1193 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063466, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,467 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=17,queue=1,port=16020] ipc.RpcServer: callId: 1192 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063465, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,467 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1194 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063467, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,468 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1187 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063465, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,472 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1195 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063468, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,474 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1196 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063473, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,474 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1197 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063474, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,475 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1198 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063475, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,477 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1199 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063476, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,477 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51969dda9dfa8895c283f334f944e248/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:36:13,482 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/665f3f34ec072c60acee3dc78af73b62/recovered.edits/13018.seqid, newMaxSeqId=13018, maxSeqId=13016 2018-05-02 06:36:13,482 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,482 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,482 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,485 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:36:13,485 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xD0\xD7\x945\xE5\x0Dy&,1525239890069.51969dda9dfa8895c283f334f944e248. 2018-05-02 06:36:13,486 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing bcf3e62f0ae8e672bee1318720d62930, disabling compactions & flushes 2018-05-02 06:36:13,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:36:13,489 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,489 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,489 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,489 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:36:13,489 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,8f5c28ea,1525237868269.665f3f34ec072c60acee3dc78af73b62. 2018-05-02 06:36:13,489 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,490 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 51119cebc42546d1c9f2590eec5a49b3, disabling compactions & flushes 2018-05-02 06:36:13,490 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:36:13,501 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/29fe0b7866912efc70bb3f2d7fd83059/recovered.edits/12778.seqid, newMaxSeqId=12778, maxSeqId=12776 2018-05-02 06:36:13,506 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,506 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,507 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,507 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:36:13,507 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,e147ae02,1525238855422.29fe0b7866912efc70bb3f2d7fd83059. 2018-05-02 06:36:13,507 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,508 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 0fc1f394ae11e950c87a982abf7c1035, disabling compactions & flushes 2018-05-02 06:36:13,508 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:36:13,537 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/51119cebc42546d1c9f2590eec5a49b3/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:13,543 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,543 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,543 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,544 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:36:13,544 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x00\x00\x00\x00\x00\x00\x00\x00,1525239890069.51119cebc42546d1c9f2590eec5a49b3. 2018-05-02 06:36:13,544 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,545 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 5fc7cfd582bc270c530fe9787011078c, disabling compactions & flushes 2018-05-02 06:36:13,545 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:36:13,549 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bcf3e62f0ae8e672bee1318720d62930/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:36:13,561 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,561 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,561 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,562 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:36:13,562 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xA8k\xCA\x1A\xF2\x86\xBC\x8A,1525241408832.bcf3e62f0ae8e672bee1318720d62930. 2018-05-02 06:36:13,562 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,563 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 51c9fc854cbebfa25ed419e23bd8ac74, disabling compactions & flushes 2018-05-02 06:36:13,563 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:36:13,606 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/0fc1f394ae11e950c87a982abf7c1035/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:36:13,617 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,618 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,618 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,618 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:36:13,618 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xAF(k\xCA\x1A\xF2\x86\xA4,1525241408832.0fc1f394ae11e950c87a982abf7c1035. 2018-05-02 06:36:13,618 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,619 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing c963eb77dbdc6dbab886dbe4eebba5ad, disabling compactions & flushes 2018-05-02 06:36:13,619 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:36:13,681 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/5fc7cfd582bc270c530fe9787011078c/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:13,683 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/c963eb77dbdc6dbab886dbe4eebba5ad/recovered.edits/12258.seqid, newMaxSeqId=12258, maxSeqId=12256 2018-05-02 06:36:13,684 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/51c9fc854cbebfa25ed419e23bd8ac74/recovered.edits/12314.seqid, newMaxSeqId=12314, maxSeqId=12312 2018-05-02 06:36:13,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,685 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:36:13,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,!\xAF(k\xCA\x1A\xF2\x82,1525239890069.5fc7cfd582bc270c530fe9787011078c. 2018-05-02 06:36:13,685 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,686 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 93f2d602c0a0a654856fb16863c2ff38, disabling compactions & flushes 2018-05-02 06:36:13,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:36:13,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,687 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:36:13,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,47ae1475,1525237868269.c963eb77dbdc6dbab886dbe4eebba5ad. 2018-05-02 06:36:13,688 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 3ea52812fafc49b1651e26e1bd43ec97, disabling compactions & flushes 2018-05-02 06:36:13,688 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:36:13,692 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,692 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,692 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,696 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:36:13,697 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1200 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063692, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,697 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,28f5c28c,1525237868269.51c9fc854cbebfa25ed419e23bd8ac74. 2018-05-02 06:36:13,701 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1201 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063697, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,701 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,702 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing dc953453430fbf031584084fad7c31bd, disabling compactions & flushes 2018-05-02 06:36:13,702 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:36:13,727 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3ea52812fafc49b1651e26e1bd43ec97/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:36:13,729 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/93f2d602c0a0a654856fb16863c2ff38/recovered.edits/431.seqid, newMaxSeqId=431, maxSeqId=429 2018-05-02 06:36:13,736 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/dc953453430fbf031584084fad7c31bd/recovered.edits/12701.seqid, newMaxSeqId=12701, maxSeqId=12699 2018-05-02 06:36:13,742 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,742 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,742 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,742 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:36:13,742 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,W\x945\xE5\x0DyCR,1525239890069.3ea52812fafc49b1651e26e1bd43ec97. 2018-05-02 06:36:13,742 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,743 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 93aea36f9251cfe49e28f84a517e3630, disabling compactions & flushes 2018-05-02 06:36:13,743 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:36:13,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,749 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:36:13,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,749 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x0DyC^P\xD7\x944,1525239890069.93f2d602c0a0a654856fb16863c2ff38. 2018-05-02 06:36:13,750 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:36:13,750 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 47c574242e461d8e7a12972718bc27ff, disabling compactions & flushes 2018-05-02 06:36:13,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,a3d70a30,1525238855422.dc953453430fbf031584084fad7c31bd. 2018-05-02 06:36:13,751 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,750 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:36:13,751 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 5c3fc4872d744c7bdc4c539ee55dc094, disabling compactions & flushes 2018-05-02 06:36:13,752 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:36:13,783 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1202 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063783, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,784 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1204 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063783, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,819 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/93aea36f9251cfe49e28f84a517e3630/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:36:13,826 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,826 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,826 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,826 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:36:13,826 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x1A\xF2\x86\xBC\xA1\xAF(h,1525241408832.93aea36f9251cfe49e28f84a517e3630. 2018-05-02 06:36:13,826 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,827 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing bc0d9cf47453518915ae21d2cf637c18, disabling compactions & flushes 2018-05-02 06:36:13,827 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:36:13,841 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/5c3fc4872d744c7bdc4c539ee55dc094/recovered.edits/12205.seqid, newMaxSeqId=12205, maxSeqId=12203 2018-05-02 06:36:13,850 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,850 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,850 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,850 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:36:13,850 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,6666665e,1525238855422.5c3fc4872d744c7bdc4c539ee55dc094. 2018-05-02 06:36:13,850 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,851 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 3bbeffd33dfc99ea8862c8eae819df62, disabling compactions & flushes 2018-05-02 06:36:13,851 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:36:13,856 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/47c574242e461d8e7a12972718bc27ff/recovered.edits/431.seqid, newMaxSeqId=431, maxSeqId=429 2018-05-02 06:36:13,867 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,867 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,867 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,867 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:36:13,867 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525239890069.47c574242e461d8e7a12972718bc27ff. 2018-05-02 06:36:13,867 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,868 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 7386aea828f5bbf6f2bb9358162092e6, disabling compactions & flushes 2018-05-02 06:36:13,869 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:36:13,878 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1205 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063877, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,879 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1203 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063877, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,879 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1207 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063878, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,880 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1208 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063880, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,880 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=17,queue=1,port=16020] ipc.RpcServer: callId: 1206 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063877, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,881 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=16,queue=0,port=16020] ipc.RpcServer: callId: 1212 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063880, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,881 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 1209 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243063880, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,882 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 1213 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063882, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,882 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1210 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063882, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,884 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=19,queue=1,port=16020] ipc.RpcServer: callId: 1211 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063883, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,885 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=15,queue=1,port=16020] ipc.RpcServer: callId: 1214 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063883, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,885 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=18,queue=0,port=16020] ipc.RpcServer: callId: 1215 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243063883, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:13,889 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bc0d9cf47453518915ae21d2cf637c18/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:36:13,899 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,899 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,899 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,899 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:36:13,899 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,r\x86\xBC\xA1\xAF(k\xBA,1525241408832.bc0d9cf47453518915ae21d2cf637c18. 2018-05-02 06:36:13,899 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,900 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 6cfc24cc3a423e0969138ce2a69be99e, disabling compactions & flushes 2018-05-02 06:36:13,900 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:36:13,922 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7386aea828f5bbf6f2bb9358162092e6/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:13,930 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,930 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,930 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,932 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:36:13,933 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/3bbeffd33dfc99ea8862c8eae819df62/recovered.edits/12479.seqid, newMaxSeqId=12479, maxSeqId=12477 2018-05-02 06:36:13,934 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\x1A\xF2\x86\xBC\xA1\xAF(h,1525239890069.7386aea828f5bbf6f2bb9358162092e6. 2018-05-02 06:36:13,934 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,935 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 9f9b6704233f2d2e06a5634fda7f94ca, disabling compactions & flushes 2018-05-02 06:36:13,935 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:36:13,937 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,943 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:36:13,943 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,c28f5c19,1525238855422.3bbeffd33dfc99ea8862c8eae819df62. 2018-05-02 06:36:13,943 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,945 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing fa24e8d8fdd999d38faae5dbf847c334, disabling compactions & flushes 2018-05-02 06:36:13,945 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:36:13,968 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/6cfc24cc3a423e0969138ce2a69be99e/recovered.edits/12259.seqid, newMaxSeqId=12259, maxSeqId=12257 2018-05-02 06:36:13,976 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,976 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,976 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,976 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:36:13,985 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,ae147ad3,1525237868269.6cfc24cc3a423e0969138ce2a69be99e. 2018-05-02 06:36:13,985 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 8dc6fd2022c2fdf8c065fbd16cadaaca, disabling compactions & flushes 2018-05-02 06:36:13,986 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:36:13,993 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/fa24e8d8fdd999d38faae5dbf847c334/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:36:13,998 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:13,998 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:13,998 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:13,998 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:36:13,999 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x145\xE5\x0DyC^N,1525241408832.fa24e8d8fdd999d38faae5dbf847c334. 2018-05-02 06:36:13,999 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:13,999 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 8c7dd0ad2a67fa6a32d1f3694eef56eb, disabling compactions & flushes 2018-05-02 06:36:13,999 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:36:14,005 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/9f9b6704233f2d2e06a5634fda7f94ca/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:14,277 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Waiting on 24 regions to close 2018-05-02 06:36:14,280 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1216 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243064279, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,280 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1217 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064279, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,281 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,281 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,281 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,282 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:36:14,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xBC\xA1\xAF(k\xCA\x1A\xD8,1525241408832.9f9b6704233f2d2e06a5634fda7f94ca. 2018-05-02 06:36:14,282 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,282 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 3f499471b0415a38ad5efe046913cba2, disabling compactions & flushes 2018-05-02 06:36:14,283 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:36:14,300 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/ATLAS_ENTITY_AUDIT_EVENTS/8dc6fd2022c2fdf8c065fbd16cadaaca/recovered.edits/80.seqid, newMaxSeqId=80, maxSeqId=78 2018-05-02 06:36:14,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,304 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,305 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:36:14,305 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed ATLAS_ENTITY_AUDIT_EVENTS,,1525237234232.8dc6fd2022c2fdf8c065fbd16cadaaca. 2018-05-02 06:36:14,305 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,306 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 9c38689b653a37956f2ae7364b126f1b, disabling compactions & flushes 2018-05-02 06:36:14,306 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:36:14,364 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/9c38689b653a37956f2ae7364b126f1b/recovered.edits/12776.seqid, newMaxSeqId=12776, maxSeqId=12774 2018-05-02 06:36:14,365 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/8c7dd0ad2a67fa6a32d1f3694eef56eb/recovered.edits/12815.seqid, newMaxSeqId=12815, maxSeqId=12813 2018-05-02 06:36:14,371 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,371 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,371 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,371 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:36:14,371 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/3f499471b0415a38ad5efe046913cba2/recovered.edits/431.seqid, newMaxSeqId=431, maxSeqId=429 2018-05-02 06:36:14,371 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,,1525237868269.8c7dd0ad2a67fa6a32d1f3694eef56eb. 2018-05-02 06:36:14,372 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,372 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 6e9424b67ac115dc3547de9b3eb4c5ef, disabling compactions & flushes 2018-05-02 06:36:14,372 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,372 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,372 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:36:14,372 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,373 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:36:14,373 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,eb851ea5,1525237868269.9c38689b653a37956f2ae7364b126f1b. 2018-05-02 06:36:14,373 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,373 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 685781049fdcc89efe3561b69e4d3810, disabling compactions & flushes 2018-05-02 06:36:14,373 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:36:14,374 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,374 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,374 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,374 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:36:14,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xDEP\xD7\x945\xE5\x0DZ,1525239890069.3f499471b0415a38ad5efe046913cba2. 2018-05-02 06:36:14,375 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 60955ebb25dcf0aeb6d46e894a921538, disabling compactions & flushes 2018-05-02 06:36:14,375 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:36:14,384 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1218 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064384, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,385 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1219 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064385, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,385 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1220 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064385, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,386 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1221 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243064386, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,392 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=5,queue=1,port=16020] ipc.RpcServer: callId: 1222 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064391, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,393 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1224 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064392, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,393 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1223 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064392, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,393 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1225 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243064392, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,394 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1226 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064394, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,395 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1227 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064395, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,396 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1228 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064396, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,398 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1229 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064397, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,398 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1230 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243064398, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,404 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1231 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243064403, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:14,484 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/hbase/namespace/60955ebb25dcf0aeb6d46e894a921538/recovered.edits/48.seqid, newMaxSeqId=48, maxSeqId=46 2018-05-02 06:36:14,485 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/6e9424b67ac115dc3547de9b3eb4c5ef/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:14,486 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/685781049fdcc89efe3561b69e4d3810/recovered.edits/431.seqid, newMaxSeqId=431, maxSeqId=429 2018-05-02 06:36:14,490 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,490 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,490 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,491 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:36:14,491 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,491 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,491 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,491 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:36:14,492 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,492 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,492 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,492 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:36:14,492 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,P\xD7\x945\xE5\x0Dy8,1525239890069.685781049fdcc89efe3561b69e4d3810. 2018-05-02 06:36:14,492 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,493 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing bb19a5bd59b1b3dff86020949234aaf5, disabling compactions & flushes 2018-05-02 06:36:14,493 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:36:14,497 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,^P\xD7\x945\xE5\x0Dl,1525239890069.6e9424b67ac115dc3547de9b3eb4c5ef. 2018-05-02 06:36:14,497 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,498 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 1595f38ee901be7c67b997fe2fc95951, disabling compactions & flushes 2018-05-02 06:36:14,498 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:36:14,502 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed hbase:namespace,,1525237101404.60955ebb25dcf0aeb6d46e894a921538. 2018-05-02 06:36:14,502 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,503 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 70ed82a86a0f0c62d692e8ffd1c0f904, disabling compactions & flushes 2018-05-02 06:36:14,503 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:36:14,557 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/70ed82a86a0f0c62d692e8ffd1c0f904/recovered.edits/416.seqid, newMaxSeqId=416, maxSeqId=414 2018-05-02 06:36:14,565 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,565 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,565 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,565 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:36:14,565 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\xF9C^P\xD7\x945\xC2,1525241408832.70ed82a86a0f0c62d692e8ffd1c0f904. 2018-05-02 06:36:14,566 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,566 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 36261edb1d6e5ae1d91cf96e60680ebc, disabling compactions & flushes 2018-05-02 06:36:14,566 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:36:14,574 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/bb19a5bd59b1b3dff86020949234aaf5/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:36:14,579 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,579 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,579 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/1595f38ee901be7c67b997fe2fc95951/recovered.edits/11485.seqid, newMaxSeqId=11485, maxSeqId=11483 2018-05-02 06:36:14,579 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,580 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:36:14,580 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,J\x1A\xF2\x86\xBC\xA1\xAF\x1E,1525241408832.bb19a5bd59b1b3dff86020949234aaf5. 2018-05-02 06:36:14,580 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,581 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 7d91c8087e31e21951799651a5262353, disabling compactions & flushes 2018-05-02 06:36:14,581 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:36:14,583 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,587 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,587 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,587 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:36:14,590 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,3333332f,1525238855422.1595f38ee901be7c67b997fe2fc95951. 2018-05-02 06:36:14,590 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,592 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing 46af8f9145c39f07531ceaa92c7f8dbc, disabling compactions & flushes 2018-05-02 06:36:14,592 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:36:14,599 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/36261edb1d6e5ae1d91cf96e60680ebc/recovered.edits/16.seqid, newMaxSeqId=16, maxSeqId=14 2018-05-02 06:36:14,602 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,602 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,602 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,602 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:36:14,602 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xFF\xFF\xFF\xFF\xFF\xFF\xFF\xFF,1525239890069.36261edb1d6e5ae1d91cf96e60680ebc. 2018-05-02 06:36:14,603 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,603 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing a47cc34ca47759b3fd7bcaa79faebd3d, disabling compactions & flushes 2018-05-02 06:36:14,603 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:36:14,634 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/7d91c8087e31e21951799651a5262353/recovered.edits/19.seqid, newMaxSeqId=19, maxSeqId=17 2018-05-02 06:36:14,641 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/46af8f9145c39f07531ceaa92c7f8dbc/recovered.edits/425.seqid, newMaxSeqId=425, maxSeqId=423 2018-05-02 06:36:14,643 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,643 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,643 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,643 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:36:14,644 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,,1525239890069.7d91c8087e31e21951799651a5262353. 2018-05-02 06:36:14,644 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,644 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 084aa7d8a3bd4d7483494d5a2c39d5df, disabling compactions & flushes 2018-05-02 06:36:14,644 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:36:14,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,645 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:36:14,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,C^P\xD7\x945\xE5\x04,1525239890069.46af8f9145c39f07531ceaa92c7f8dbc. 2018-05-02 06:36:14,645 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing b5180eee96b616afdf79578309c66a11, disabling compactions & flushes 2018-05-02 06:36:14,645 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:36:14,681 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/a47cc34ca47759b3fd7bcaa79faebd3d/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:36:14,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,685 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,686 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,686 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:36:14,686 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,<\xA1\xAF(k\xCA\x1A\xEA,1525241408832.a47cc34ca47759b3fd7bcaa79faebd3d. 2018-05-02 06:36:14,686 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 530aabaf92e988eadd5338ed38b9be0c, disabling compactions & flushes 2018-05-02 06:36:14,687 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:36:14,702 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/084aa7d8a3bd4d7483494d5a2c39d5df/recovered.edits/12613.seqid, newMaxSeqId=12613, maxSeqId=12611 2018-05-02 06:36:14,704 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_namenode/b5180eee96b616afdf79578309c66a11/recovered.edits/12174.seqid, newMaxSeqId=12174, maxSeqId=12172 2018-05-02 06:36:14,707 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,707 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,707 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,707 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,707 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,708 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,708 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:36:14,708 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:36:14,708 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,7ae147a4,1525238855422.084aa7d8a3bd4d7483494d5a2c39d5df. 2018-05-02 06:36:14,708 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_namenode,6666665e,1525237868269.b5180eee96b616afdf79578309c66a11. 2018-05-02 06:36:14,708 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,708 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing f61045f3bb8866c33d9b05635d777d75, disabling compactions & flushes 2018-05-02 06:36:14,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 45aba4505046246827a28b03d1c2611e, disabling compactions & flushes 2018-05-02 06:36:14,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:36:14,709 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:36:14,758 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/530aabaf92e988eadd5338ed38b9be0c/recovered.edits/419.seqid, newMaxSeqId=419, maxSeqId=417 2018-05-02 06:36:14,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,766 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:36:14,766 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,\x00\x00\x00\x00\x00\x00\x00\x00,1525241408832.530aabaf92e988eadd5338ed38b9be0c. 2018-05-02 06:36:14,767 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,767 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 1fa0746104343e63d4a6c982f8a3bf32, disabling compactions & flushes 2018-05-02 06:36:14,767 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:36:14,777 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/f61045f3bb8866c33d9b05635d777d75/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:36:14,784 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/45aba4505046246827a28b03d1c2611e/recovered.edits/428.seqid, newMaxSeqId=428, maxSeqId=426 2018-05-02 06:36:14,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,785 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,786 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:36:14,786 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,(k\xCA\x1A\xF2\x86\xBC\x9C,1525239890069.f61045f3bb8866c33d9b05635d777d75. 2018-05-02 06:36:14,786 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,787 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closing a8ff96226d546f0ea151823ae73e5a1b, disabling compactions & flushes 2018-05-02 06:36:14,787 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:36:14,787 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,787 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,787 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,787 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:36:14,788 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am,\xAF(k\xCA\x1A\xF2\x86\xA4,1525239890069.45aba4505046246827a28b03d1c2611e. 2018-05-02 06:36:14,788 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,789 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closing 41c625158570994727f1c92a8606ca6c, disabling compactions & flushes 2018-05-02 06:36:14,789 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Updates disabled for region test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:36:14,839 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/1fa0746104343e63d4a6c982f8a3bf32/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:36:14,849 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,849 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,849 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,849 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:36:14,849 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,!\xAF(k\xCA\x1A\xF2\x82,1525241408832.1fa0746104343e63d4a6c982f8a3bf32. 2018-05-02 06:36:14,849 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:36:14,850 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closing 94f6ca283dbb4445b2bcdc321b734d28, disabling compactions & flushes 2018-05-02 06:36:14,850 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Updates disabled for region test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:36:14,902 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/a8ff96226d546f0ea151823ae73e5a1b/recovered.edits/11471.seqid, newMaxSeqId=11471, maxSeqId=11469 2018-05-02 06:36:14,910 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,910 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,910 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,910 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:36:14,910 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,b851eb76,1525238855422.a8ff96226d546f0ea151823ae73e5a1b. 2018-05-02 06:36:14,921 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am-namenode/41c625158570994727f1c92a8606ca6c/recovered.edits/422.seqid, newMaxSeqId=422, maxSeqId=420 2018-05-02 06:36:14,923 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_load_test_tool_hbase/94f6ca283dbb4445b2bcdc321b734d28/recovered.edits/13422.seqid, newMaxSeqId=13422, maxSeqId=13420 2018-05-02 06:36:14,933 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,933 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,933 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,933 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] regionserver.HRegion: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:36:14,933 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-2] handler.CloseRegionHandler: Closed test_hbase_ha_load_test_tool_hbase,1eb851e9,1525238855422.94f6ca283dbb4445b2bcdc321b734d28. 2018-05-02 06:36:14,934 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:36:14,934 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:36:14,934 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] coprocessor.CoprocessorHost: Stop coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:36:14,934 INFO [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] regionserver.HRegion: Closed test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:36:14,934 DEBUG [RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-1] handler.CloseRegionHandler: Closed test_hbase_ha_loadAndVerify_am-namenode,^P\xD7\x945\xE5\x0Dl,1525241408832.41c625158570994727f1c92a8606ca6c. 2018-05-02 06:36:15,081 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: stopping server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009; all regions closed. 2018-05-02 06:36:15,082 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:36:15,298 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1232 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065296, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,301 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1233 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243065297, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,391 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1234 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065390, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,392 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1235 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065392, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,393 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1236 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243065393, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,399 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1237 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065398, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,400 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1238 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065399, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,400 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1239 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065399, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,402 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1241 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065401, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,403 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1240 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065401, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,403 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1242 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065402, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,408 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=14,queue=0,port=16020] ipc.RpcServer: callId: 1245 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243065408, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,409 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1244 service: ClientService methodName: Get size: 113 connection: 172.27.61.83:49948 deadline: 1525243065408, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,409 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=9,queue=1,port=16020] ipc.RpcServer: callId: 1243 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065407, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,410 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1246 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065410, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,417 DEBUG [RpcServer.priority.FPBQ.Fifo.handler=7,queue=1,port=16020] ipc.RpcServer: callId: 1247 service: ClientService methodName: Get size: 110 connection: 172.27.61.83:49948 deadline: 1525243065415, exception=org.apache.hadoop.hbase.regionserver.RegionServerStoppedException: Server ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 stopping 2018-05-02 06:36:15,542 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:36:15,542 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525242833009.meta:.meta(num 1525242856572) 2018-05-02 06:36:15,554 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.FSHLog: Closing WAL writer in /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:36:15,585 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Moved 1 WAL file(s) to /apps/hbase/data/oldWALs 2018-05-02 06:36:15,585 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Closed WAL: FSHLog ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525242833009:(num 1525242855946) 2018-05-02 06:36:15,585 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Stopping rpc client 2018-05-02 06:36:15,587 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Leases: Closed leases 2018-05-02 06:36:15,593 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.ChoreService: Chore service for: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 had [[ScheduledChore: Name: CompactionThroughputTuner Period: 60000 Unit: MILLISECONDS]] on shutdown 2018-05-02 06:36:15,595 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020.logRoller] regionserver.LogRoller: LogRoller exiting. 2018-05-02 06:36:15,624 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.NettyRpcServer: Stopping server on /172.27.70.95:16020 2018-05-02 06:36:15,626 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSecretManager: Stopping leader election, because: SecretManager stopping 2018-05-02 06:36:15,627 DEBUG [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Interrupted waiting on leader java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.hadoop.hbase.zookeeper.ZKLeaderManager.waitToBecomeLeader(ZKLeaderManager.java:143) at org.apache.hadoop.hbase.security.token.AuthenticationTokenSecretManager$LeaderElector.run(AuthenticationTokenSecretManager.java:336) 2018-05-02 06:36:15,754 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/rs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009 2018-05-02 06:36:15,888 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=Disconnected, path=null 2018-05-02 06:36:15,889 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received Disconnected from ZooKeeper, ignoring 2018-05-02 06:36:15,889 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=Disconnected, path=null 2018-05-02 06:36:15,889 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c010d, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received Disconnected from ZooKeeper, ignoring 2018-05-02 06:36:15,889 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ZooKeeper: Session: 0x1631f08b26c010d closed 2018-05-02 06:36:15,889 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Exiting; stopping=ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009; zookeeper connection closed. 2018-05-02 06:36:15,889 INFO [main-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:36:15,889 INFO [pool-7-thread-1] regionserver.ShutdownHook: Starting fs shutdown hook thread. 2018-05-02 06:36:15,891 INFO [pool-7-thread-1] regionserver.ShutdownHook: Shutdown hook finished. Wed May 2 06:37:22 UTC 2018 Starting regionserver on ctr-e138-1518143905142-279227-01-000002.hwx.site core file size (blocks, -c) unlimited data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 1031588 max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited 2018-05-02 06:37:26,541 INFO [main] regionserver.HRegionServer: STARTING executorService HRegionServer 2018-05-02 06:37:26,554 INFO [main] util.VersionInfo: HBase 2.0.0.3.0.0.0-1288 2018-05-02 06:37:26,554 INFO [main] util.VersionInfo: Source code repository git://ctr-e138-1518143905142-227583-01-000002.hwx.site/grid/0/jenkins/workspace/HDP-parallel-centos7/SOURCES/hbase revision=8ba1ae89d0957aadb12876df248121f2d2772223 2018-05-02 06:37:26,555 INFO [main] util.VersionInfo: Compiled by jenkins on Wed May 2 00:50:45 UTC 2018 2018-05-02 06:37:26,555 INFO [main] util.VersionInfo: From source with checksum d982560abfda9fab240ec700a7f58e79 2018-05-02 06:37:27,414 INFO [main] util.ServerCommandLine: hbase.tmp.dir: /tmp/hbase-hbase 2018-05-02 06:37:27,414 INFO [main] util.ServerCommandLine: hbase.rootdir: hdfs://mycluster/apps/hbase/data 2018-05-02 06:37:27,415 INFO [main] util.ServerCommandLine: hbase.cluster.distributed: true 2018-05-02 06:37:27,415 INFO [main] util.ServerCommandLine: hbase.zookeeper.quorum: ctr-e138-1518143905142-279227-01-000006.hwx.site,ctr-e138-1518143905142-279227-01-000008.hwx.site,ctr-e138-1518143905142-279227-01-000007.hwx.site 2018-05-02 06:37:27,417 INFO [main] util.ServerCommandLine: env:PATH=/usr/sbin:/sbin:/usr/lib/ambari-server/*:/usr/lib64/qt-3.3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/var/lib/ambari-agent 2018-05-02 06:37:27,417 INFO [main] util.ServerCommandLine: env:HISTCONTROL=ignoredups 2018-05-02 06:37:27,417 INFO [main] util.ServerCommandLine: env:HBASE_PID_DIR=/var/run/hbase 2018-05-02 06:37:27,417 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVER_OPTS= -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:37:27,418 INFO [main] util.ServerCommandLine: env:JAVA_OPTS= -Duser.timezone=UTC 2018-05-02 06:37:27,418 INFO [main] util.ServerCommandLine: env:HBASE_CONF_DIR=/usr/hdp/current/hbase-regionserver/conf 2018-05-02 06:37:27,419 INFO [main] util.ServerCommandLine: env:MAIL=/var/spool/mail/hbase 2018-05-02 06:37:27,419 INFO [main] util.ServerCommandLine: env:LD_LIBRARY_PATH=::/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:37:27,419 INFO [main] util.ServerCommandLine: env:LOGNAME=hbase 2018-05-02 06:37:27,419 INFO [main] util.ServerCommandLine: env:HBASE_REST_OPTS= 2018-05-02 06:37:27,419 INFO [main] util.ServerCommandLine: env:PWD=/run/hbase 2018-05-02 06:37:27,420 INFO [main] util.ServerCommandLine: env:HBASE_ROOT_LOGGER=INFO,RFA 2018-05-02 06:37:27,420 INFO [main] util.ServerCommandLine: env:LESSOPEN=||/usr/bin/lesspipe.sh %s 2018-05-02 06:37:27,420 INFO [main] util.ServerCommandLine: env:SHELL=/bin/bash 2018-05-02 06:37:27,420 INFO [main] util.ServerCommandLine: env:QT_GRAPHICSSYSTEM_CHECKED=1 2018-05-02 06:37:27,420 INFO [main] util.ServerCommandLine: env:HBASE_ENV_INIT=true 2018-05-02 06:37:27,420 INFO [main] util.ServerCommandLine: env:PHOENIX_QUERYSERVER_OPTS= -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_queryserver_jaas.conf 2018-05-02 06:37:27,420 INFO [main] util.ServerCommandLine: env:QTINC=/usr/lib64/qt-3.3/include 2018-05-02 06:37:27,420 INFO [main] util.ServerCommandLine: env:HBASE_MASTER_OPTS= -Xmx1024m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_master_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false 2018-05-02 06:37:27,420 INFO [main] util.ServerCommandLine: env:HBASE_MANAGES_ZK=false 2018-05-02 06:37:27,421 INFO [main] util.ServerCommandLine: env:HBASE_REGIONSERVERS=/usr/hdp/current/hbase-regionserver/conf/regionservers 2018-05-02 06:37:27,421 INFO [main] util.ServerCommandLine: env:HADOOP_HOME=/usr/hdp/3.0.0.0-1288/hadoop 2018-05-02 06:37:27,421 INFO [main] util.ServerCommandLine: env:HBASE_NICENESS=0 2018-05-02 06:37:27,421 INFO [main] util.ServerCommandLine: env:HBASE_OPTS=-Dhdp.version=3.0.0.0-1288 -XX:+UseG1GC -XX:MaxGCPauseMillis=100 -XX:-ResizePLAB -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf -Djava.io.tmpdir=/grid/0/hbase-tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020637 -XX:ReservedCodeCacheSize=256m -Xms2048m -Xmx2048m -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf -Djavax.security.auth.useSubjectCredsOnly=false -Dhbase.log.dir=/grid/0/log/hbase -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS 2018-05-02 06:37:27,421 INFO [main] util.ServerCommandLine: env:HBASE_SECURITY_LOGGER=INFO,RFAS 2018-05-02 06:37:27,421 INFO [main] util.ServerCommandLine: env:SHLVL=3 2018-05-02 06:37:27,421 INFO [main] util.ServerCommandLine: env:ZOOKEEPER_HOME=/usr/hdp/3.0.0.0-1288/zookeeper 2018-05-02 06:37:27,421 INFO [main] util.ServerCommandLine: env:HBASE_LOGFILE=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log 2018-05-02 06:37:27,421 INFO [main] util.ServerCommandLine: env:HISTSIZE=1000 2018-05-02 06:37:27,422 INFO [main] util.ServerCommandLine: env:JAVA_HOME=/usr/lib/jvm/java-openjdk 2018-05-02 06:37:27,422 INFO [main] util.ServerCommandLine: env:HDP_VERSION=3.0.0.0-1288 2018-05-02 06:37:27,422 INFO [main] util.ServerCommandLine: env:LANG=en_US.UTF-8 2018-05-02 06:37:27,423 INFO [main] util.ServerCommandLine: env:XDG_SESSION_ID=409596 2018-05-02 06:37:27,423 INFO [main] util.ServerCommandLine: env:HBASE_CLASSPATH=/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:37:27,423 INFO [main] util.ServerCommandLine: env:no_proxy=0.0.0.0,localhost,127.0.0.1,.openstacklocal,.novalocal,169.254.169.254,openstack.eng.hortonworks.com,dashboard.qe.hortonworks.com,172.22.192.250,192.175.27.100,ad-ec2.qe.hortonworks.com,ad-nano.qe.hortonworks.com,.site,.hwx.site,.hwx.site.com,172.27.0.101,172.27.70.95,172.27.61.83,172.27.59.154,172.27.69.22,172.27.59.21,172.27.70.17 2018-05-02 06:37:27,423 INFO [main] util.ServerCommandLine: env:http_proxy=http://hwx-eng:5XD6xKQDiKDjOD@cache.eng.hortonworks.com:1280 2018-05-02 06:37:27,423 INFO [main] util.ServerCommandLine: env:HBASE_IDENT_STRING=hbase 2018-05-02 06:37:27,423 INFO [main] util.ServerCommandLine: env:HBASE_ZNODE_FILE=/var/run/hbase/hbase-hbase-regionserver.znode 2018-05-02 06:37:27,423 INFO [main] util.ServerCommandLine: env:HBASE_LOG_PREFIX=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:37:27,423 INFO [main] util.ServerCommandLine: env:HBASE_LOG_DIR=/grid/0/log/hbase 2018-05-02 06:37:27,424 INFO [main] util.ServerCommandLine: env:USER=hbase 2018-05-02 06:37:27,475 INFO [main] util.ServerCommandLine: env:CLASSPATH=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/hadoop/.//*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//*:/usr/hdp/3.0.0.0-1288/tez/*:/usr/hdp/3.0.0.0-1288/tez/lib/*:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/*:/usr/hdp/3.0.0.0-1288/hadoop/lib/*:/usr/hdp/3.0.0.0-1288/zookeeper/*: 2018-05-02 06:37:27,476 INFO [main] util.ServerCommandLine: env:SERVER_GC_OPTS=-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/grid/0/log/hbase/gc.log-201805020637 2018-05-02 06:37:27,493 INFO [main] util.ServerCommandLine: env:HADOOP_CONF=/usr/hdp/3.0.0.0-1288/hadoop/conf 2018-05-02 06:37:27,493 INFO [main] util.ServerCommandLine: env:HBASE_AUTOSTART_FILE=/var/run/hbase/hbase-hbase-regionserver.autostart 2018-05-02 06:37:27,493 INFO [main] util.ServerCommandLine: env:HOSTNAME=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:37:27,494 INFO [main] util.ServerCommandLine: env:QTDIR=/usr/lib64/qt-3.3 2018-05-02 06:37:27,494 INFO [main] util.ServerCommandLine: env:HBASE_THRIFT_OPTS= 2018-05-02 06:37:27,494 INFO [main] util.ServerCommandLine: env:HBASE_HOME=/usr/hdp/current/hbase-regionserver/bin/.. 2018-05-02 06:37:27,494 INFO [main] util.ServerCommandLine: env:QTLIB=/usr/lib64/qt-3.3/lib 2018-05-02 06:37:27,494 INFO [main] util.ServerCommandLine: env:HOME=/var/run/hbase 2018-05-02 06:37:27,494 INFO [main] util.ServerCommandLine: env:MALLOC_ARENA_MAX=4 2018-05-02 06:37:27,504 INFO [main] util.ServerCommandLine: vmName=OpenJDK 64-Bit Server VM, vmVendor=Oracle Corporation, vmVersion=25.161-b14 2018-05-02 06:37:27,505 INFO [main] util.ServerCommandLine: vmInputArguments=[-Dproc_regionserver, -XX:OnOutOfMemoryError=kill -9 %p, -Dhdp.version=3.0.0.0-1288, -XX:+UseG1GC, -XX:MaxGCPauseMillis=100, -XX:-ResizePLAB, -XX:ErrorFile=/grid/0/log/hbase/hs_err_pid%p.log, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_client_jaas.conf, -Djava.io.tmpdir=/grid/0/hbase-tmp, -verbose:gc, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -Xloggc:/grid/0/log/hbase/gc.log-201805020637, -XX:ReservedCodeCacheSize=256m, -Xms2048m, -Xmx2048m, -Djava.security.auth.login.config=/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf, -Djavax.security.auth.useSubjectCredsOnly=false, -Dhbase.log.dir=/grid/0/log/hbase, -Dhbase.log.file=hbase-hbase-regionserver-ctr-e138-1518143905142-279227-01-000002.hwx.site.log, -Dhbase.home.dir=/usr/hdp/current/hbase-regionserver/bin/.., -Dhbase.id.str=hbase, -Dhbase.root.logger=INFO,RFA, -Djava.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native, -Dhbase.security.logger=INFO,RFAS] 2018-05-02 06:37:27,919 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:37:29,534 INFO [main] beanutils.FluentPropertyBeanIntrospector: Error when creating PropertyDescriptor for public final void org.apache.commons.configuration2.AbstractConfiguration.setProperty(java.lang.String,java.lang.Object)! Ignoring this property. 2018-05-02 06:37:29,656 INFO [main] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:37:30,725 INFO [main] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:37:30,739 INFO [main] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:37:32,478 INFO [main] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:37:32,478 INFO [main] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:37:32,478 INFO [main] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:37:32,649 INFO [main] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:37:33,158 INFO [main] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:37:33,158 INFO [main] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:37:33,256 INFO [main] metrics.MetricRegistries: Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2018-05-02 06:37:34,276 INFO [main] regionserver.RSRpcServices: regionserver/ctr-e138-1518143905142-279227-01-000002:16020 server-side Connection retries=105 2018-05-02 06:37:34,304 INFO [main] ipc.RpcExecutor: Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:37:34,307 INFO [main] ipc.RpcExecutor: Instantiated priority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=300, handlerCount=20 2018-05-02 06:37:34,308 INFO [main] ipc.RpcExecutor: Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=300, handlerCount=3 2018-05-02 06:37:34,308 INFO [main] ipc.PhoenixRpcSchedulerFactory: Using custom Phoenix Index RPC Handling with index rpc priority 1000 and metadata rpc priority 2000 2018-05-02 06:37:34,315 INFO [main] ipc.RpcExecutor: Instantiated Index.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:37:34,315 INFO [main] ipc.RpcExecutor: Instantiated Metadata.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=3, maxQueueLength=300, handlerCount=30 2018-05-02 06:37:34,828 INFO [main] ipc.RpcServerFactory: Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2018-05-02 06:37:35,516 INFO [main] io.ByteBufferPool: Created with bufferSize=64 KB and maxPoolSize=1.88 KB 2018-05-02 06:37:35,575 DEBUG [main] util.ClassSize: Using Unsafe to estimate memory layout 2018-05-02 06:37:35,781 INFO [main] ipc.NettyRpcServer: Bind to /172.27.70.95:16020 2018-05-02 06:37:36,321 INFO [main] security.UserGroupInformation: Login successful for user hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM using keytab file /etc/security/keytabs/hbase.service.keytab 2018-05-02 06:37:36,324 WARN [main] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:37:36,327 INFO [main] hfile.CacheConfig: Allocating onheap LruBlockCache size=204.80 MB, blockSize=64 KB 2018-05-02 06:37:36,349 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:36,351 INFO [main] hfile.CacheConfig: Created cacheConfig: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:37:36,358 DEBUG [main] mob.MobFileCache: MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2018-05-02 06:37:39,590 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:37:39,640 INFO [main] fs.HFileSystem: Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2018-05-02 06:37:40,039 INFO [main] zookeeper.RecoverableZooKeeper: Process identifier=regionserver:16020 connecting to ZooKeeper ensemble=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 2018-05-02 06:37:40,098 INFO [main] zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1288--1, built on 05/02/2018 00:32 GMT 2018-05-02 06:37:40,098 INFO [main] zookeeper.ZooKeeper: Client environment:host.name=ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:37:40,098 INFO [main] zookeeper.ZooKeeper: Client environment:java.version=1.8.0_161 2018-05-02 06:37:40,098 INFO [main] zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation 2018-05-02 06:37:40,098 INFO [main] zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.161-0.b14.el7_4.x86_64/jre 2018-05-02 06:37:40,098 INFO [main] zookeeper.ZooKeeper: Client environment:java.class.path=/usr/hdp/current/hbase-regionserver/conf:/usr/lib/jvm/java-openjdk/lib/tools.jar:/usr/hdp/current/hbase-regionserver/bin/..:/usr/hdp/current/hbase-regionserver/bin/../lib/accessors-smart-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aopalliance-repackaged-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/asm-5.0.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/atlas-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/audience-annotations-0.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/avro-1.7.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-beanutils-1.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-cli-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-codec-1.10.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-collections-3.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-compress-1.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-configuration2-2.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-crypto-1.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-csv-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-daemon-1.0.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-io-2.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang-2.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-lang3-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-logging-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-math3-3.6.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/commons-net-3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-client-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-framework-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/curator-recipes-4.0.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/disruptor-3.3.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/dnsjava-2.1.7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ehcache-3.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/findbugs-annotations-1.3.9-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/fst-2.50.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/gson-2.2.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guava-11.0.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/guice-servlet-4.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-annotations.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-backup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-bridge-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-common.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-endpoint.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-examples.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-external-blockcache.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop2-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-hadoop-compat.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-http.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-it.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics-api.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-metrics.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-procedure.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-protocol-shaded.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-replication.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-resource-bundle.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rest.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-rsgroup.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-client.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-mapreduce.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-miscellaneous-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-netty-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shaded-protobuf-2.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-shell.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark-it-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-spark.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-testing-util.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-thrift.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper-2.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hbase-zookeeper.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/HikariCP-java7-2.4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-api-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-locator-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/hk2-utils-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core-3.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/htrace-core4-4.2.0-incubating.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpclient-4.5.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/httpcore-4.4.6.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-core-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-databind-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-base-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-jaxrs-json-provider-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-jaxb-annotations-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-paranamer-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-module-scala_2.11-2.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jackson-xc-1.9.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jamon-runtime-2.4.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javassist-3.20.0-GA.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/java-util-1.9.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.annotation-api-1.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.el-3.0.1-b08.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.inject-2.5.0-b32.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet-api-3.1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-2.3.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp-api-2.3.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.0.v201105211821.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.servlet.jsp.jstl-1.2.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/javax.ws.rs-api-2.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-api-2.2.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcip-annotations-1.0-1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jcodings-1.0.18.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-client-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-common-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-container-servlet-core-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-guava-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-media-jaxb-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jersey-server-2.25.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jettison-1.3.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jmx-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-jsp-9.2.19.v20160908.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-schemas-3.1.M0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/joni-2.1.11.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsch-0.1.54.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-io-2.5.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/json-smart-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/jsr311-api-1.1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/junit-4.12.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/leveldbjni-all-1.8.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/libthrift-0.9.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/log4j-1.2.17.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/metrics-core-3.2.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-all-4.0.52.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-buffer-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-codec-http-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-common-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-handler-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-resolver-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/netty-transport-4.1.17.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okhttp-2.7.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/okio-1.6.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/org.eclipse.jdt.core-3.8.2.v20130121.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/osgi-resource-locator-1.0.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/paranamer-2.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/phoenix-server.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/protobuf-java-2.5.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-hbase-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/re2j-1.1.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/slf4j-api-1.7.25.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/snappy-java-1.0.5.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/spymemcached-2.12.2.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/stax2-api-3.1.4.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/validation-api-1.1.0.Final.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/woodstox-core-5.0.3.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/xz-1.0.jar:/usr/hdp/current/hbase-regionserver/bin/../lib/zookeeper.jar:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/.//hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/./:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okhttp-2.7.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-ajax-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/okio-1.6.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-all-4.0.52.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/json-simple-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-client-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-httpfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-native-client-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-rbf-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/lib/*:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-keyvault-core-0.8.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//kafka-clients-0.8.2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-transport-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-http-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aliyun-sdk-oss-2.8.3.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-common-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aws.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-aliyun.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//aws-java-sdk-bundle-1.11.271.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-codec-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//ojalgo-43.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-plugins.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-streaming-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-handler-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-hs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-openstack-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//jdom-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archives-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//lz4-1.2.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-data-lake-store-sdk-2.2.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//azure-storage-5.4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-buffer-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-examples.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-resourceestimator.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-uploader-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-archive-logs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-fs2img.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-kafka-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-gridmix.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-app.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-datajoin.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-jobclient-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-extras-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-nativetask-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-azure-datalake.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-sls.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-shuffle.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-mapreduce-client-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-distcp-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//netty-resolver-4.1.17.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop-mapreduce/.//hadoop-rumen-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/./:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/HikariCP-java7-2.4.12.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/mssql-jdbc-6.2.1.jre7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/ehcache-3.3.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/javax.inject-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-module-jaxb-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/snakeyaml-1.16.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/geronimo-jcache_1.0_spec-1.0-alpha-1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/json-io-2.5.1.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/fst-2.50.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/aopalliance-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-base-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/swagger-annotations-1.5.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jersey-guice-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/java-util-1.9.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/dnsjava-2.1.7.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/guice-servlet-4.0.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/lib/jackson-jaxrs-json-provider-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-web-proxy.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-resourcemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-distributedshell.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-client.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-router-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-sharedcachemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-common.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-applications-unmanaged-am-launcher-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-api-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-registry-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-applicationhistoryservice-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-services-core.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-nodemanager.jar:/usr/hdp/3.0.0.0-1288/hadoop-yarn/.//hadoop-yarn-server-tests-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/conf:/usr/hdp/3.0.0.0-1288/tez/conf_llap:/usr/hdp/3.0.0.0-1288/tez/doc:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/hadoop-shim-2.8-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib:/usr/hdp/3.0.0.0-1288/tez/man:/usr/hdp/3.0.0.0-1288/tez/tez-api-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-common-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-dag-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-examples-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-history-parser-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-javadoc-tools-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-job-analyzer-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-mapreduce-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-protobuf-history-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-internals-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-runtime-library-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-tests-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-cache-plugin-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-acls-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/tez-yarn-timeline-history-with-fs-0.9.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/ui:/usr/hdp/3.0.0.0-1288/tez/lib/async-http-client-1.8.16.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-codec-1.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-collections4-4.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-io-2.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/tez/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/tez/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-hdfs-client-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-mapreduce-client-core-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/hadoop-yarn-server-timeline-pluginstorage-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-client-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jettison-1.3.4.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-server-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jetty-util-9.3.22.v20171030.jar:/usr/hdp/3.0.0.0-1288/tez/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/metrics-core-3.1.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/tez/lib/RoaringBitmap-0.4.9.jar:/usr/hdp/3.0.0.0-1288/tez/lib/servlet-api-2.5.jar:/usr/hdp/3.0.0.0-1288/tez/lib/slf4j-api-1.7.10.jar:/usr/hdp/3.0.0.0-1288/tez/lib/tez.tar.gz:/usr/hdp/3.0.0.0-1288/hadoop/conf:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-auth-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-tests.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-annotations-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-kms.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-common-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/hadoop-nfs-3.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-xc-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-logging-1.1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-server-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-hdfs-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang3-3.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/re2j-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-api-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-client-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpcore-4.4.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/gson-2.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/htrace-core4-4.1.0-incubating.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288-sources.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-client-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-config-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr305-3.0.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jcip-annotations-1.0-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-configuration2-2.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-pkix-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-identity-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-http-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-recipes-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-mapper-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-simplekdc-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/httpclient-4.5.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/asm-5.0.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-cli-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jul-to-slf4j-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/avro-1.7.7.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-io-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/stax2-api-3.1.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-core-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-compress-1.4.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-admin-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-annotations-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/token-provider-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/woodstox-core-5.0.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-webapp-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-jaxrs-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-net-3.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/javax.servlet-api-3.1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/guava-11.0.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-security-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-servlet-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hamcrest-core-1.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsr311-api-1.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-lang-2.6.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-util-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-server-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-xml-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-core-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/mockito-all-1.8.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/protobuf-java-2.5.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsch-0.1.54.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-server-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/hadoop-lzo-0.6.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-plugin-classloader-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jersey-json-1.19.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/nimbus-jose-jwt-4.41.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/json-smart-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-crypto-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/metrics-core-3.2.4.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-beanutils-1.9.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jaxb-api-2.2.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-math3-3.1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-collections-3.2.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-xdr-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/netty-3.10.5.Final.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/log4j-1.2.17.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-util-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/paranamer-2.3.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/junit-4.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerb-common-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/ranger-yarn-plugin-shim-1.0.0.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-core-asl-1.9.13.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jetty-servlet-9.3.19.v20170502.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/kerby-asn1-1.0.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/curator-framework-2.12.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-codec-1.11.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jsp-api-2.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jettison-1.1.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/accessors-smart-1.2.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/xz-1.0.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/slf4j-log4j12-1.7.25.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/snappy-java-1.0.5.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/jackson-databind-2.7.8.jar:/usr/hdp/3.0.0.0-1288/hadoop/lib/commons-io-2.5.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper-3.4.6.3.0.0.0-1288.jar:/usr/hdp/3.0.0.0-1288/zookeeper/zookeeper.jar: 2018-05-02 06:37:40,113 INFO [main] zookeeper.ZooKeeper: Client environment:java.library.path=:/usr/hdp/3.0.0.0-1288/hadoop/lib/native/Linux-amd64-64:/usr/hdp/3.0.0.0-1288/hadoop/lib/native 2018-05-02 06:37:40,113 INFO [main] zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/grid/0/hbase-tmp 2018-05-02 06:37:40,113 INFO [main] zookeeper.ZooKeeper: Client environment:java.compiler= 2018-05-02 06:37:40,113 INFO [main] zookeeper.ZooKeeper: Client environment:os.name=Linux 2018-05-02 06:37:40,113 INFO [main] zookeeper.ZooKeeper: Client environment:os.arch=amd64 2018-05-02 06:37:40,114 INFO [main] zookeeper.ZooKeeper: Client environment:os.version=4.15.12-1.el7.elrepo.x86_64 2018-05-02 06:37:40,114 INFO [main] zookeeper.ZooKeeper: Client environment:user.name=hbase 2018-05-02 06:37:40,114 INFO [main] zookeeper.ZooKeeper: Client environment:user.home=/var/run/hbase 2018-05-02 06:37:40,114 INFO [main] zookeeper.ZooKeeper: Client environment:user.dir=/run/hbase 2018-05-02 06:37:40,115 INFO [main] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.PendingWatcher@47af099e 2018-05-02 06:37:40,206 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.Login: successfully logged in. 2018-05-02 06:37:40,211 INFO [Thread-8] zookeeper.Login: TGT refresh thread started. 2018-05-02 06:37:40,246 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:37:40,262 INFO [Thread-8] zookeeper.Login: TGT valid starting at: Wed May 02 06:37:40 UTC 2018 2018-05-02 06:37:40,262 INFO [Thread-8] zookeeper.Login: TGT expires: Thu May 03 06:37:40 UTC 2018 2018-05-02 06:37:40,263 INFO [Thread-8] zookeeper.Login: TGT refresh sleeping until: Thu May 03 02:19:22 UTC 2018 2018-05-02 06:37:40,270 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:37:40,287 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, initiating session 2018-05-02 06:37:40,313 INFO [main-SendThread(ctr-e138-1518143905142-279227-01-000006.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000006.hwx.site/172.27.70.17:2181, sessionid = 0x1631f08b26c0113, negotiated timeout = 90000 2018-05-02 06:37:40,320 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:160200x0, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2018-05-02 06:37:40,321 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c0113 connected 2018-05-02 06:37:40,427 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c0113, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=None, state=SaslAuthenticated, path=null 2018-05-02 06:37:40,782 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:37:40,782 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:37:40,782 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 13 2018-05-02 06:37:40,782 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:37:40,782 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:37:40,782 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:37:40,782 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:37:40,782 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:37:40,782 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:37:40,783 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:37:40,783 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:37:40,783 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:37:40,783 DEBUG [main] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:37:40,808 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586 2018-05-02 06:37:41,467 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=default.FPBQ.Fifo, numCallQueues=3, port=16020 2018-05-02 06:37:41,588 DEBUG [main] ipc.RpcExecutor: Started handlerCount=20 with threadPrefix=priority.FPBQ.Fifo, numCallQueues=2, port=16020 2018-05-02 06:37:41,593 DEBUG [main] ipc.RpcExecutor: Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=16020 2018-05-02 06:37:41,906 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Index.Fifo, numCallQueues=3, port=16020 2018-05-02 06:37:42,008 DEBUG [main] ipc.RpcExecutor: Started handlerCount=30 with threadPrefix=Metadata.Fifo, numCallQueues=3, port=16020 2018-05-02 06:37:42,286 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.keypassword" was found through the Configuration getPassword method. 2018-05-02 06:37:42,286 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.keystore.password" was found through the Configuration getPassword method. 2018-05-02 06:37:42,287 DEBUG [main] hbase.HBaseConfiguration: Config option "ssl.server.truststore.password" was found through the Configuration getPassword method. 2018-05-02 06:37:42,331 INFO [main] util.log: Logging initialized @17688ms 2018-05-02 06:37:42,516 INFO [main] http.HttpRequestLog: Http request log for http.requests.regionserver is not defined 2018-05-02 06:37:42,561 INFO [main] http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.hbase.http.HttpServer$QuotingInputFilter) 2018-05-02 06:37:42,566 INFO [main] http.HttpServer: Added global filter 'clickjackingprevention' (class=org.apache.hadoop.hbase.http.ClickjackingPreventionFilter) 2018-05-02 06:37:42,572 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context regionserver 2018-05-02 06:37:42,573 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs 2018-05-02 06:37:42,574 INFO [main] http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.hbase.http.lib.StaticUserWebFilter$StaticUserFilter) to context static 2018-05-02 06:37:42,669 INFO [main] http.HttpServer: Jetty bound to port 20030 2018-05-02 06:37:42,672 INFO [main] server.Server: jetty-9.3.19.v20170502 2018-05-02 06:37:42,899 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@18d910b3{/logs,file:///grid/0/log/hbase/,AVAILABLE} 2018-05-02 06:37:42,900 INFO [main] handler.ContextHandler: Started o.e.j.s.ServletContextHandler@625d9132{/static,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/static/,AVAILABLE} 2018-05-02 06:37:43,420 INFO [main] handler.ContextHandler: Started o.e.j.w.WebAppContext@14a049f9{/,file:///usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver/,AVAILABLE}{file:/usr/hdp/3.0.0.0-1288/hbase/hbase-webapps/regionserver} 2018-05-02 06:37:43,429 INFO [main] ssl.SslContextFactory: x509=X509@2100d047(ctr-e138-1518143905142-279227-01-000002.hwx.site,h=[ctr-e138-1518143905142-279227-01-000002.hwx.site],w=[]) for SslContextFactory@4af45442(file:///etc/security/serverKeys/keystore.jks,file:///etc/security/serverKeys/truststore.jks) 2018-05-02 06:37:43,455 INFO [main] server.AbstractConnector: Started ServerConnector@1d6f02f{SSL,[ssl, http/1.1]}{0.0.0.0:20030} 2018-05-02 06:37:43,455 INFO [main] server.Server: Started @18812ms 2018-05-02 06:37:43,500 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: ClusterId : 1b48ec3a-bf8b-4867-bad7-52eb7796791c 2018-05-02 06:37:43,508 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initializing 2018-05-02 06:37:43,596 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc initialized 2018-05-02 06:37:43,596 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initializing 2018-05-02 06:37:43,618 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot initialized 2018-05-02 06:37:43,763 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] zookeeper.ReadOnlyZKClient: Connect 0x20350acf to ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 with session timeout=90000ms, retries 6, retry interval 1000ms, keepAlive=60000ms 2018-05-02 06:37:43,790 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x20350acf] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181 sessionTimeout=90000 watcher=org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1366478241@147049eb 2018-05-02 06:37:43,793 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x20350acf-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:37:43,796 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x20350acf-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:37:43,800 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x20350acf-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 06:37:43,809 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x20350acf-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d93900d2, negotiated timeout = 90000 2018-05-02 06:37:44,015 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@86ffa26, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=null 2018-05-02 06:37:44,025 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.AbstractRpcClient: Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d9ffa9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=false, bind address=ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:0 2018-05-02 06:37:44,043 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ShutdownHook: Installed shutdown hook thread: Shutdownhook:regionserver/ctr-e138-1518143905142-279227-01-000002:16020 2018-05-02 06:37:44,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: System coprocessor loading is enabled 2018-05-02 06:37:44,095 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.RegionServerCoprocessorHost: Table coprocessor loading is enabled 2018-05-02 06:37:44,162 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/javax.persistence-2.1.0.jar 2018-05-02 06:37:44,162 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/gson-2.2.4.jar 2018-05-02 06:37:44,162 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-audit-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:44,162 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpclient-4.5.3.jar 2018-05-02 06:37:44,162 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-common-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:44,163 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/eclipselink-2.5.2.jar 2018-05-02 06:37:44,163 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-plugins-cred-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:44,163 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/solr-solrj-6.6.1.jar 2018-05-02 06:37:44,163 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpmime-4.5.3.jar 2018-05-02 06:37:44,163 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/httpcore-4.4.6.jar 2018-05-02 06:37:44,163 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/ranger-hbase-plugin-1.0.0.3.0.0.0-1288.jar 2018-05-02 06:37:44,163 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] classloader.RangerPluginClassLoaderUtil: getFilesInDirectory('/usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl'): adding /usr/hdp/3.0.0.0-1288/hbase/lib/ranger-hbase-plugin-impl/noggit-0.6.jar 2018-05-02 06:37:44,402 DEBUG [RS-EventLoopGroup-1-2] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:37:44,417 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:37:44,417 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:44,434 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:37:44,452 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:37:44,464 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:37:44,465 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:44,493 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:37:44,495 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:44,496 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:37:44,497 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:44,497 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:37:44,499 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:44,501 DEBUG [RS-EventLoopGroup-1-3] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:44,504 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:44,505 DEBUG [RS-EventLoopGroup-1-2] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:37:44,505 DEBUG [RS-EventLoopGroup-1-2] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:37:44,522 DEBUG [RS-EventLoopGroup-1-3] ipc.RpcServer: SASL server context established. Authenticated client: atlas/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:37:44,731 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Registered regionserver coprocessor executorService: executorService=AccessControlService 2018-05-02 06:37:44,754 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Adding Super User(hbase) 2018-05-02 06:37:44,760 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-audit.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-audit.xml 2018-05-02 06:37:44,762 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] config.RangerConfiguration: addResourceIfReadable(ranger-hbase-security.xml): resource file is file:/etc/hbase/3.0.0.0-1288/0/ranger-hbase-security.xml 2018-05-02 06:37:44,778 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: creating.. 2018-05-02 06:37:44,778 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditProviderFactory: initializing.. 2018-05-02 06:37:45,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.service.name=cl1_hbase 2018-05-02 06:37:45,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.url=https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6182 2018-05-02 06:37:45,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs=false 2018-05-02 06:37:45,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.useKeyTab=true 2018-05-02 06:37:45,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.rest.ssl.config.file=/etc/hbase/conf/ranger-policymgr-ssl.xml 2018-05-02 06:37:45,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.is.enabled=true 2018-05-02 06:37:45,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.batch.filespool.dir=/var/log/hbase/audit/solr/spool 2018-05-02 06:37:45,100 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.hbase.update.xapolicies.on.grant.revoke=true 2018-05-02 06:37:45,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.force.use.inmemory.jaas.config=true 2018-05-02 06:37:45,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.keyTab=/etc/security/keytabs/hbase.service.keytab 2018-05-02 06:37:45,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.dir=hdfs://mycluster/ranger/audit 2018-05-02 06:37:45,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr.zookeepers=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:37:45,101 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.hdfs.batch.filespool.dir=/var/log/hbase/audit/hdfs/spool 2018-05-02 06:37:45,110 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.principal=hbase/_HOST@EXAMPLE.COM 2018-05-02 06:37:45,110 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.pollIntervalMs=30000 2018-05-02 06:37:45,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.source.impl=org.apache.ranger.admin.client.RangerAdminRESTClient 2018-05-02 06:37:45,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.policy.cache.dir=/etc/ranger/cl1_hbase/policycache 2018-05-02 06:37:45,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleControlFlag=required 2018-05-02 06:37:45,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: ranger.plugin.hbase.ambari.cluster.name=cl1 2018-05-02 06:37:45,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.provider.summary.enabled=true 2018-05-02 06:37:45,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.destination.solr=true 2018-05-02 06:37:45,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.storeKey=false 2018-05-02 06:37:45,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.loginModuleName=com.sun.security.auth.module.Krb5LoginModule 2018-05-02 06:37:45,111 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AUDIT PROPERTY: xasecure.audit.jaas.Client.option.serviceName=solr 2018-05-02 06:37:45,112 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Audit destination xasecure.audit.destination.solr is set to true 2018-05-02 06:37:45,181 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.AuditDestination: AuditDestination() enter 2018-05-02 06:37:45,182 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: init() called 2018-05-02 06:37:45,182 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:45,182 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr 2018-05-02 06:37:45,182 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: Using providerName from property prefix. providerName=solr 2018-05-02 06:37:45,183 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=solr 2018-05-02 06:37:45,183 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: ==>SolrAuditDestination.init() 2018-05-02 06:37:45,183 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:37:45,183 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Loading SolrClient JAAS config from Ranger audit config if present... 2018-05-02 06:37:45,248 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: In solrAuditDestination.init() (finally) : JAAS Configuration set as [/usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf] 2018-05-02 06:37:45,249 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: <==SolrAuditDestination.init() 2018-05-02 06:37:45,249 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Solr zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr, solrURLs=null, collectionName=ranger_audits 2018-05-02 06:37:45,249 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] destination.SolrAuditDestination: Connecting to solr cloud using zkHosts=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr 2018-05-02 06:37:45,608 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] impl.Krb5HttpClientConfigurer: Setting up SPNego auth with config: /usr/hdp/current/hbase-regionserver/conf/hbase_regionserver_jaas.conf 2018-05-02 06:37:45,974 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: xasecure.audit.destination.solr.queue is not set. Setting queue to batch for solr 2018-05-02 06:37:45,975 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: queue for solr is batch 2018-05-02 06:37:45,997 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:37:45,997 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:45,997 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.destination.solr.batch 2018-05-02 06:37:45,997 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=batch 2018-05-02 06:37:46,001 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is enabled for batch, logFolderProp=/var/log/hbase/audit/solr/spool, xasecure.audit.destination.solr.batch.filespool.dir=false 2018-05-02 06:37:46,048 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: retryDestinationMS=30000, queueName=batch 2018-05-02 06:37:46,048 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: fileRolloverSec=86400, queueName=batch 2018-05-02 06:37:46,048 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: maxArchiveFiles=100, queueName=batch 2018-05-02 06:37:46,048 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFolder=/var/log/hbase/audit/solr/spool, queueName=batch 2018-05-02 06:37:46,049 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: logFileNameFormat=spool_%app-type%_%time:yyyyMMdd-HHmm.ss%.log, queueName=batch 2018-05-02 06:37:46,049 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: archiveFolder=/var/log/hbase/audit/solr/spool/archive, queueName=batch 2018-05-02 06:37:46,049 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json, queueName=batch 2018-05-02 06:37:46,049 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: indexDoneFile=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional_closed.json, queueName=batch 2018-05-02 06:37:46,049 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Loading index file. fileName=/var/log/hbase/audit/solr/spool/index_batch_batch.solr_hbaseRegional.json 2018-05-02 06:37:46,161 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: currentWriterIndexRecord=/var/log/hbase/audit/solr/spool/spool_hbaseRegional_20180502-0636.11.log, queueName=batch 2018-05-02 06:37:46,161 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== START 2018-05-02 06:37:46,162 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX=AuditIndexRecord [id=fb138bc6-ac22-4b81-a0d5-8bf6f22f3297, filePath=/var/log/hbase/audit/solr/spool/spool_hbaseRegional_20180502-0636.11.log, linePosition=0, status=write_inprogress, fileCreateTime=Wed May 02 06:36:11 UTC 2018, writeCompleteTime=null, doneCompleteTime=null, lastSuccessTime=null, lastFailedTime=null, failedAttemptCount=0, lastAttempt=true], isFileExist=true 2018-05-02 06:37:46,162 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: INDEX printIndex() ==== END 2018-05-02 06:37:46,162 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Using v3 audit configuration 2018-05-02 06:37:46,162 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: AuditSummaryQueue is enabled 2018-05-02 06:37:46,167 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:37:46,167 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:46,167 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider 2018-05-02 06:37:46,167 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=summary 2018-05-02 06:37:46,168 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for summary 2018-05-02 06:37:46,168 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditSummaryQueue: maxSummaryInterval=5000, name=summary 2018-05-02 06:37:46,173 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: BaseAuditProvider.init() 2018-05-02 06:37:46,173 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: BaseAuditProvider.init() 2018-05-02 06:37:46,173 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: propPrefix=xasecure.audit.provider.async 2018-05-02 06:37:46,173 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.BaseAuditHandler: providerName=async 2018-05-02 06:37:46,181 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditQueue: File spool is disabled for async 2018-05-02 06:37:46,181 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] provider.AuditProviderFactory: Starting audit queue hbaseRegional.async 2018-05-02 06:37:46,181 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditBatchQueue: Creating ArrayBlockingQueue with maxSize=1048576 2018-05-02 06:37:46,202 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] queue.AuditFileSpool: Starting writerThread, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:37:46,238 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false } 2018-05-02 06:37:46,256 INFO [Ranger async Audit cleanup] provider.AuditProviderFactory: RangerAsyncAuditCleanup: Waiting to audit cleanup start signal 2018-05-02 06:37:48,058 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getKeyManagers(RangerRESTClient.java:272) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:188) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:37:49,241 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] fs.FSInputChecker: Problem opening checksum file: file:/etc/ranger/cl1_hbase/cred.jceks. Ignoring exception: java.io.FileNotFoundException: /etc/ranger/cl1_hbase/.cred.jceks.crc (Permission denied) at java.io.FileInputStream.open0(Native Method) at java.io.FileInputStream.open(FileInputStream.java:195) at java.io.FileInputStream.(FileInputStream.java:138) at org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileInputStream.(RawLocalFileSystem.java:110) at org.apache.hadoop.fs.RawLocalFileSystem.open(RawLocalFileSystem.java:212) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:152) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:347) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:950) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.getInputStreamForFile(JavaKeyStoreProvider.java:70) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.locateKeystore(AbstractJavaKeyStoreProvider.java:321) at org.apache.hadoop.security.alias.AbstractJavaKeyStoreProvider.(AbstractJavaKeyStoreProvider.java:86) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:49) at org.apache.hadoop.security.alias.JavaKeyStoreProvider.(JavaKeyStoreProvider.java:41) at org.apache.hadoop.security.alias.JavaKeyStoreProvider$Factory.createProvider(JavaKeyStoreProvider.java:100) at org.apache.hadoop.security.alias.CredentialProviderFactory.getProviders(CredentialProviderFactory.java:73) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialProviders(RangerCredentialProvider.java:70) at org.apache.ranger.authorization.hadoop.utils.RangerCredentialProvider.getCredentialString(RangerCredentialProvider.java:46) at org.apache.ranger.plugin.util.RangerRESTClient.getCredential(RangerRESTClient.java:386) at org.apache.ranger.plugin.util.RangerRESTClient.getTrustManagers(RangerRESTClient.java:323) at org.apache.ranger.plugin.util.RangerRESTClient.buildClient(RangerRESTClient.java:189) at org.apache.ranger.plugin.util.RangerRESTClient.getClient(RangerRESTClient.java:176) at org.apache.ranger.plugin.util.RangerRESTClient.getResource(RangerRESTClient.java:156) at org.apache.ranger.admin.client.RangerAdminRESTClient.createWebResource(RangerAdminRESTClient.java:279) at org.apache.ranger.admin.client.RangerAdminRESTClient.access$300(RangerAdminRESTClient.java:48) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:115) at org.apache.ranger.admin.client.RangerAdminRESTClient$3.run(RangerAdminRESTClient.java:113) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1662) at org.apache.ranger.admin.client.RangerAdminRESTClient.getServicePoliciesIfUpdated(RangerAdminRESTClient.java:123) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicyfromPolicyAdmin(PolicyRefresher.java:264) at org.apache.ranger.plugin.util.PolicyRefresher.loadPolicy(PolicyRefresher.java:202) at org.apache.ranger.plugin.util.PolicyRefresher.startRefresher(PolicyRefresher.java:149) at org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:222) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:1101) at org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.start(RangerAuthorizationCoprocessor.java:163) at org.apache.hadoop.hbase.coprocessor.BaseEnvironment.startup(BaseEnvironment.java:72) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.checkAndLoadInstance(CoprocessorHost.java:263) at org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:157) at org.apache.hadoop.hbase.regionserver.RegionServerCoprocessorHost.(RegionServerCoprocessorHost.java:70) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:926) at java.lang.Thread.run(Thread.java:748) 2018-05-02 06:37:53,195 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:37:53,196 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionServerObservers 2018-05-02 06:37:56,234 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:37:56,236 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:37:56,236 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:56,240 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 108 from saslServer. 2018-05-02 06:37:56,265 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:56,266 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:37:56,268 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:37:56,269 DEBUG [RS-EventLoopGroup-1-4] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:56,269 DEBUG [RS-EventLoopGroup-1-4] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:37:56,670 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.PolicyRefresher: PolicyRefresher(serviceName=cl1_hbase): found updated version. lastKnownVersion=-1; newVersion=18 2018-05-02 06:37:57,027 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=table; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=49; leafNodeCount=4; singleChildNodeCount=43; maxDepth=26; evaluatorListCount=3; wildcardEvaluatorListCount=2; evaluatorListRefCount=46; wildcardEvaluatorListRefCount=47 2018-05-02 06:37:57,027 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column-family; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:37:57,037 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.RangerResourceTrie: resourceName=column; optIgnoreCase=false; optWildcard=true; wildcardChars=*?{}\; nodeCount=1; leafNodeCount=1; singleChildNodeCount=0; maxDepth=1; evaluatorListCount=0; wildcardEvaluatorListCount=1; evaluatorListRefCount=1; wildcardEvaluatorListRefCount=0 2018-05-02 06:37:57,056 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] service.RangerBasePlugin: Policies will NOT be reordered based on number of evaluations 2018-05-02 06:37:57,057 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870911. 2018-05-02 06:37:57,073 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: reportForDuty to master=ctr-e138-1518143905142-279227-01-000005.hwx.site,20000,1525243032003 with port=16020, startcode=1525243047586 2018-05-02 06:37:57,569 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:37:57,569 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:57,569 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:37:58,008 DEBUG [RS-EventLoopGroup-1-5] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:37:58,102 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:37:58,118 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:37:58,130 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:37:58,134 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:37:58,137 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:37:58,137 DEBUG [RS-EventLoopGroup-1-5] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:37:58,334 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.rootdir=hdfs://mycluster/apps/hbase/data 2018-05-02 06:37:58,334 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: fs.defaultFS=hdfs://mycluster 2018-05-02 06:37:58,334 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Config from master: hbase.master.info.port=30010 2018-05-02 06:37:58,537 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.WALFactory: Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.FSHLogProvider 2018-05-02 06:37:58,575 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586 2018-05-02 06:38:00,109 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.Replication: Replication stats-in-log period=300 seconds 2018-05-02 06:38:00,167 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MetricsRegionServerWrapperImpl: Computing regionserver metrics every 5000 milliseconds 2018-05-02 06:38:00,403 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.MemStoreFlusher: globalMemStoreLimit=819.2 M, globalMemStoreLimitLowMark=204.8 M, Offheap=false 2018-05-02 06:38:00,462 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] throttle.PressureAwareCompactionThroughputController: Compaction throughput configurations, higher bound: 20.00 MB/second, lower bound 10.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2018-05-02 06:38:00,474 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: CompactionChecker runs every PT10S 2018-05-02 06:38:00,562 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SecureBulkLoadManager: hbase.bulkload.staging.dir is deprecated. Bulkload staging directory is hdfs://mycluster/apps/hbase/data/staging 2018-05-02 06:38:00,755 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:38:00,755 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:38:00,755 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:38:00,755 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=3, maxPoolSize=3 2018-05-02 06:38:00,755 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_CLOSE_META-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=1, maxPoolSize=1 2018-05-02 06:38:00,756 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=2, maxPoolSize=2 2018-05-02 06:38:00,756 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=10, maxPoolSize=10 2018-05-02 06:38:00,771 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] executor.ExecutorService: Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/ctr-e138-1518143905142-279227-01-000002:16020, corePoolSize=20, maxPoolSize=20 2018-05-02 06:38:01,059 INFO [SplitLogWorker-ctr-e138-1518143905142-279227-01-000002:16020] regionserver.SplitLogWorker: SplitLogWorker ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586 starting 2018-05-02 06:38:01,061 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.upperLimit is deprecated by hbase.regionserver.global.memstore.size 2018-05-02 06:38:01,071 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HeapMemoryManager: Starting, tuneOn=false 2018-05-02 06:38:01,087 WARN [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] util.MemorySizeUtil: hbase.regionserver.global.memstore.lowerLimit is deprecated. Instead use hbase.regionserver.global.memstore.size.lower.limit 2018-05-02 06:38:01,113 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating data MemStoreChunkPool with chunk size 2 MB, max count 368, initial count 0 2018-05-02 06:38:01,123 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.ChunkCreator: Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 409, initial count 0 2018-05-02 06:38:01,158 INFO [ReplicationExecutor-0] regionserver.ReplicationSourceManager: Current list of replicators: [ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525243042691, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242616896, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242440996, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525243041096, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525242861963, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525242896337, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525242833009, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586, ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525242849572, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525242875683] other RSs: [ctr-e138-1518143905142-279227-01-000003.hwx.site,16020,1525243041096, ctr-e138-1518143905142-279227-01-000006.hwx.site,16020,1525243042691, ctr-e138-1518143905142-279227-01-000008.hwx.site,16020,1525243043663, ctr-e138-1518143905142-279227-01-000007.hwx.site,16020,1525243046037, ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586] 2018-05-02 06:38:01,230 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] regionserver.HRegionServer: Serving as ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586, RpcServer on ctr-e138-1518143905142-279227-01-000002.hwx.site/172.27.70.95:16020, sessionid=0x1631f08b26c0113 2018-05-02 06:38:01,231 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc starting 2018-05-02 06:38:01,231 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] flush.RegionServerFlushTableProcedureManager: Start region server flush procedure manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586 2018-05-02 06:38:01,231 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586' 2018-05-02 06:38:01,231 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/flush-table-proc/abort' 2018-05-02 06:38:01,238 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/flush-table-proc/acquired' 2018-05-02 06:38:01,244 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure flush-table-proc started 2018-05-02 06:38:01,244 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot starting 2018-05-02 06:38:01,244 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] snapshot.RegionServerSnapshotManager: Start Snapshot Manager ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586 2018-05-02 06:38:01,244 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Starting procedure member 'ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586' 2018-05-02 06:38:01,244 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Checking for aborted procedures on node: '/hbase-secure/online-snapshot/abort' 2018-05-02 06:38:01,247 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.ZKProcedureMemberRpcs: Looking for new procedures under znode:'/hbase-secure/online-snapshot/acquired' 2018-05-02 06:38:01,255 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] procedure.RegionServerProcedureManagerHost: Procedure online-snapshot started 2018-05-02 06:38:01,255 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerRpcQuotaManager: Quota support disabled 2018-05-02 06:38:01,255 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] quotas.RegionServerSpaceQuotaManager: Quota support disabled, not starting space quota manager. 2018-05-02 06:38:04,521 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525243047586, suffix=, logDir=hdfs://mycluster/apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586, archiveDir=hdfs://mycluster/apps/hbase/data/oldWALs 2018-05-02 06:38:06,029 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Slow sync cost: 1007 ms, current pipeline: [] 2018-05-02 06:38:06,030 INFO [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: New WAL /apps/hbase/data/WALs/ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586/ctr-e138-1518143905142-279227-01-000002.hwx.site%2C16020%2C1525243047586.1525243084522 2018-05-02 06:38:06,035 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] wal.AbstractFSWAL: Create new FSHLog writer with pipeline: [DatanodeInfoWithStorage[172.27.70.95:1019,DS-c30041a7-2616-4a29-a976-faff11951b12,DISK], DatanodeInfoWithStorage[172.27.59.154:1019,DS-3f0a484e-4d42-4272-88c2-1681f96c2e8c,DISK], DatanodeInfoWithStorage[172.27.59.21:1019,DS-cda034b4-5e96-4bd8-a379-7af6cb377ad2,DISK]] 2018-05-02 06:38:06,321 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000002.hwx.site@EXAMPLE.COM 2018-05-02 06:38:06,322 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Created SASL server with mechanism = GSSAPI 2018-05-02 06:38:06,322 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 738 for processing by saslServer.evaluateResponse() 2018-05-02 06:38:06,326 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 107 from saslServer. 2018-05-02 06:38:06,328 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 0 for processing by saslServer.evaluateResponse() 2018-05-02 06:38:06,328 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Will send token of size 32 from saslServer. 2018-05-02 06:38:06,331 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: Have read input token of size 32 for processing by saslServer.evaluateResponse() 2018-05-02 06:38:06,332 DEBUG [RS-EventLoopGroup-1-6] security.HBaseSaslRpcServer: SASL server GSSAPI callback: setting canonicalized client ID: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM 2018-05-02 06:38:06,332 DEBUG [RS-EventLoopGroup-1-6] ipc.RpcServer: SASL server context established. Authenticated client: hbase/ctr-e138-1518143905142-279227-01-000005.hwx.site@EXAMPLE.COM (auth:KERBEROS). Negotiated QoP is auth-conf 2018-05-02 06:38:06,436 INFO [RpcServer.default.FPBQ.Fifo.handler=29,queue=2,port=16020] regionserver.RSRpcServices: Open test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:38:06,808 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opening region: {ENCODED => ab4e529620b9089675ab2d6f3446a39c, NAME => 'test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c.', STARTKEY => '\x86\xBC\xA1\xAF(k\xCA\x08', ENDKEY => '\x8DyC^P\xD7\x94"'} 2018-05-02 06:38:06,892 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=AuthenticationService 2018-05-02 06:38:06,940 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870911. 2018-05-02 06:38:06,961 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=SecureBulkLoadService 2018-05-02 06:38:06,961 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. 2018-05-02 06:38:06,961 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] access.SecureBulkLoadEndpoint: Secure bulk load has been integrated into HBase core. 2018-05-02 06:38:06,962 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870912. 2018-05-02 06:38:06,962 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Registered coprocessor service: region=test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. service=AccessControlService 2018-05-02 06:38:06,967 WARN [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.HbaseUserUtilsImpl: HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! 2018-05-02 06:38:06,967 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] coprocessor.CoprocessorHost: System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870913. 2018-05-02 06:38:07,010 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.MetricsRegionSourceImpl: Creating new MetricsRegionSourceImpl for table test_hbase_ha_loadAndVerify_am ab4e529620b9089675ab2d6f3446a39c 2018-05-02 06:38:07,011 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Instantiated test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:38:07,038 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] hbase.RangerAuthorizationCoprocessor: Unable to get remote Address 2018-05-02 06:38:07,264 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1 2018-05-02 06:38:07,264 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] util.CommonFSUtils: Set storagePolicy=HOT for path=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1 2018-05-02 06:38:07,529 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] hfile.CacheConfig: Created cacheConfig for f1: blockCache=LruBlockCache{blockCount=0, currentSize=154.61 KB, freeSize=204.65 MB, maxSize=204.80 MB, heapSize=154.61 KB, minSize=194.56 MB, minFactor=0.95, multiSize=97.28 MB, multiFactor=0.5, singleSize=48.64 MB, singleFactor=0.25}, cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false 2018-05-02 06:38:07,603 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] compactions.CompactionConfiguration: size [128 MB, 8.00 EB, 8.00 EB); files [3, 10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 600000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory 2018-05-02 06:38:08,295 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1/2a4d0a4a276a427f956af1d693600d04 2018-05-02 06:38:08,341 DEBUG [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] regionserver.HStore: loaded hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/f1/fbf50f6c80344b5190d76c6ce3b8f375 2018-05-02 06:38:08,346 INFO [StoreOpener-ab4e529620b9089675ab2d6f3446a39c-1] regionserver.HStore: Store=f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false 2018-05-02 06:38:08,400 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Found 0 recovered edits file(s) under hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c 2018-05-02 06:38:08,502 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] wal.WALSplitter: Wrote file=hdfs://mycluster/apps/hbase/data/data/default/test_hbase_ha_loadAndVerify_am/ab4e529620b9089675ab2d6f3446a39c/recovered.edits/426.seqid, newMaxSeqId=426, maxSeqId=425 2018-05-02 06:38:08,514 INFO [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] regionserver.HRegion: Opened ab4e529620b9089675ab2d6f3446a39c; next sequenceid=426 2018-05-02 06:38:08,581 INFO [PostOpenDeployTasks:ab4e529620b9089675ab2d6f3446a39c] regionserver.HRegionServer: Post open deploy tasks for test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:38:08,636 DEBUG [PostOpenDeployTasks:ab4e529620b9089675ab2d6f3446a39c] regionserver.HRegionServer: Finished post open deploy task for test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. 2018-05-02 06:38:08,638 DEBUG [RS_OPEN_REGION-regionserver/ctr-e138-1518143905142-279227-01-000002:16020-0] handler.OpenRegionHandler: Opened test_hbase_ha_loadAndVerify_am,\x86\xBC\xA1\xAF(k\xCA\x08,1525239890069.ab4e529620b9089675ab2d6f3446a39c. on ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586 2018-05-02 06:38:12,011 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:38:12,012 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:38:12,017 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:38:12,525 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:38:12,995 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:38:13,003 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:38:13,118 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:38:13,118 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:38:13,118 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:38:13,127 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:38:13,130 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:38:13,130 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started 2018-05-02 06:38:13,173 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl: Creating new MetricsTableSourceImpl for table 2018-05-02 06:38:13,193 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor 2018-05-02 06:38:13,194 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor Metrics about HBase RegionObservers 2018-05-02 06:38:13,194 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider 2018-05-02 06:38:13,195 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.token.TokenProvider Metrics about HBase RegionObservers 2018-05-02 06:38:13,195 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint 2018-05-02 06:38:13,195 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter: Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint Metrics about HBase RegionObservers 2018-05-02 06:38:16,221 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Closing file. Only one open file. queueName=hbaseRegional.async.summary.batch, fileName=/var/log/hbase/audit/solr/spool/spool_hbaseRegional_20180502-0636.11.log 2018-05-02 06:38:16,223 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Adding file to queue. queueName=hbaseRegional.async.summary.batch, fileName=/var/log/hbase/audit/solr/spool/spool_hbaseRegional_20180502-0636.11.log 2018-05-02 06:38:16,270 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] zookeeper.ZooKeeper: Initiating client connection, connectString=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.SolrZkClient$3@ac1a3b4 2018-05-02 06:38:16,272 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. 2018-05-02 06:38:16,274 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Opening socket connection to server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181. Will attempt to SASL-authenticate using Login Context section 'Client' 2018-05-02 06:38:16,275 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Socket connection established to ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, initiating session 2018-05-02 06:38:16,278 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter-SendThread(ctr-e138-1518143905142-279227-01-000007.hwx.site:2181)] zookeeper.ClientCnxn: Session establishment complete on server ctr-e138-1518143905142-279227-01-000007.hwx.site/172.27.59.21:2181, sessionid = 0x2631f08d93900d4, negotiated timeout = 10000 2018-05-02 06:38:16,354 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] cloud.ZkStateReader: Updated live nodes from ZooKeeper... (0) -> (1) 2018-05-02 06:38:16,374 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] impl.ZkClientClusterStateProvider: Cluster at ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181/infra-solr ready 2018-05-02 06:38:16,620 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Done reading file. file=/var/log/hbase/audit/solr/spool/spool_hbaseRegional_20180502-0636.11.log, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:38:16,620 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Removing file from index. file=/var/log/hbase/audit/solr/spool/spool_hbaseRegional_20180502-0636.11.log, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:38:16,620 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Moving to done file. /var/log/hbase/audit/solr/spool/spool_hbaseRegional_20180502-0636.11.log, queueName=hbaseRegional.async.summary.batch, consumer=hbaseRegional.async.summary.batch.solr 2018-05-02 06:38:16,621 INFO [hbaseRegional.async.summary.batch_hbaseRegional.async.summary.batch.solr_destWriter] queue.AuditFileSpool: Moving logFile /var/log/hbase/audit/solr/spool/spool_hbaseRegional_20180502-0636.11.log to /var/log/hbase/audit/solr/spool/archive/spool_hbaseRegional_20180502-0636.11.log 2018-05-02 06:38:43,946 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x20350acf] zookeeper.ZooKeeper: Session: 0x2631f08d93900d2 closed 2018-05-02 06:38:43,946 INFO [ReadOnlyZKClient-ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181@0x20350acf-EventThread] zookeeper.ClientCnxn: EventThread shut down 2018-05-02 06:38:45,292 DEBUG [RS-EventLoopGroup-1-7] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:38:46,247 INFO [org.apache.ranger.audit.queue.AuditBatchQueue0] provider.BaseAuditHandler: Audit Status Log: name=hbaseRegional.async.summary.batch, finalDestination=hbaseRegional.async.summary.batch.solr, interval=01:00.250 minutes, events=2, succcessCount=1, totalEvents=2, totalSuccessCount=1 2018-05-02 06:38:47,418 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c0113, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:38:47,422 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c0113, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/master 2018-05-02 06:38:48,300 DEBUG [RS-EventLoopGroup-1-8] ipc.FailedServers: Added failed server with address ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 to list caused by org.apache.hbase.thirdparty.io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: ctr-e138-1518143905142-279227-01-000005.hwx.site/172.27.59.154:20000 2018-05-02 06:38:51,306 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] token.AuthenticationTokenSelector: No matching token found 2018-05-02 06:38:51,308 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: RPC Server Kerberos principal name for service=RegionServerStatusService is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:38:51,308 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020] ipc.RpcConnection: Use KERBEROS authentication for service RegionServerStatusService, sasl=true 2018-05-02 06:38:51,312 DEBUG [RS-EventLoopGroup-1-9] security.AbstractHBaseSaslRpcClient: Creating SASL GSSAPI client. Server's Kerberos principal name is hbase/ctr-e138-1518143905142-279227-01-000003.hwx.site@EXAMPLE.COM 2018-05-02 06:38:51,330 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will send token of size 738 from initSASLContext. 2018-05-02 06:38:51,345 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 108 for processing by initSASLContext 2018-05-02 06:38:51,348 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will send token of size 0 from initSASLContext. 2018-05-02 06:38:51,358 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will read input token of size 32 for processing by initSASLContext 2018-05-02 06:38:51,359 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClientHandler: Will send token of size 32 from initSASLContext. 2018-05-02 06:38:51,360 DEBUG [RS-EventLoopGroup-1-9] security.NettyHBaseSaslRpcClient: SASL client context established. Negotiated QoP: auth-conf 2018-05-02 06:40:12,002 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c0113, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:40:12,003 INFO [main-EventThread] zookeeper.ZKLeaderManager: Leader change, but no new leader found 2018-05-02 06:40:12,005 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c0113, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase-secure/tokenauth/keymaster 2018-05-02 06:40:12,007 INFO [main-EventThread] zookeeper.ZKLeaderManager: Found new leader for znode: /hbase-secure/tokenauth/keymaster 2018-05-02 06:40:12,007 INFO [ZKSecretWatcher-leaderElector] zookeeper.ZKLeaderManager: Found existing leader with ID: ctr-e138-1518143905142-279227-01-000002.hwx.site,16020,1525243047586 2018-05-02 06:40:12,009 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c0113, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys 2018-05-02 06:40:12,019 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 11 2018-05-02 06:40:12,019 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 12 2018-05-02 06:40:12,019 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 13 2018-05-02 06:40:12,019 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 14 2018-05-02 06:40:12,019 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 1 2018-05-02 06:40:12,019 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 2 2018-05-02 06:40:12,019 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 3 2018-05-02 06:40:12,019 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 4 2018-05-02 06:40:12,019 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 5 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 6 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 7 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 8 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 9 2018-05-02 06:40:12,020 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 10 2018-05-02 06:40:12,020 DEBUG [main-EventThread] zookeeper.ZKWatcher: regionserver:16020-0x1631f08b26c0113, quorum=ctr-e138-1518143905142-279227-01-000006.hwx.site:2181,ctr-e138-1518143905142-279227-01-000008.hwx.site:2181,ctr-e138-1518143905142-279227-01-000007.hwx.site:2181, baseZNode=/hbase-secure Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase-secure/tokenauth/keys/13 2018-05-02 06:40:12,021 DEBUG [main-EventThread] token.AuthenticationTokenSecretManager: Adding key 13 2018-05-02 06:42:36,346 INFO [LruBlockCacheStatsExecutor] hfile.LruBlockCache: totalSize=154.61 KB, freeSize=204.65 MB, max=204.80 MB, blockCount=0, accesses=0, hits=0, hitRatio=0, cachingAccesses=0, cachingHits=0, cachingHitsRatio=0,evictions=29, evicted=0, evictedPerRun=0.0 2018-05-02 06:43:01,121 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: data stats (chunk size=2097152): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:43:01,127 DEBUG [regionserver/ctr-e138-1518143905142-279227-01-000002:16020-MemStoreChunkPool Statistics] regionserver.ChunkCreator: index stats (chunk size=209715): current pool size=0, created chunk count=0, reused chunk count=0, reuseRatio=0 2018-05-02 06:43:12,010 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Stopping HBase metrics system... 2018-05-02 06:43:12,011 INFO [timeline] impl.MetricsSinkAdapter: timeline thread interrupted. 2018-05-02 06:43:12,013 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system stopped. 2018-05-02 06:43:12,522 INFO [HBase-Metrics2-1] impl.MetricsConfig: loaded properties from hadoop-metrics2-hbase.properties 2018-05-02 06:43:12,814 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Initializing Timeline metrics sink. 2018-05-02 06:43:12,814 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Identified hostname = ctr-e138-1518143905142-279227-01-000002.hwx.site, serviceName = hbase 2018-05-02 06:43:12,894 INFO [HBase-Metrics2-1] availability.MetricSinkWriteShardHostnameHashingStrategy: Calculated collector shard ctr-e138-1518143905142-279227-01-000003.hwx.site based on hostname: ctr-e138-1518143905142-279227-01-000002.hwx.site 2018-05-02 06:43:12,894 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Collector Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/metrics 2018-05-02 06:43:12,894 INFO [HBase-Metrics2-1] timeline.HadoopTimelineMetricsSink: Container Metrics Uri: https://ctr-e138-1518143905142-279227-01-000003.hwx.site:6188/ws/v1/timeline/containermetrics 2018-05-02 06:43:12,899 INFO [HBase-Metrics2-1] impl.MetricsSinkAdapter: Sink timeline started 2018-05-02 06:43:12,903 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: Scheduled Metric snapshot period at 10 second(s). 2018-05-02 06:43:12,903 INFO [HBase-Metrics2-1] impl.MetricsSystemImpl: HBase metrics system started